-- Logs begin at Wed 2022-08-24 07:00:07 UTC, end at Wed 2022-08-24 08:39:08 UTC. -- Aug 24 07:43:04.857235 dv-cinder-854274-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:43:04.866192 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:43:04 2022] *** Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: nodename: dv-cinder-854274-1-iscsi Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: machine: x86_64 Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: clock source: unix Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: pcre jit disabled Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: detected number of CPU cores: 4 Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: current working directory: / Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:43:04.868167 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: your processes number limit is 47680 Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: your memory page size is 4096 bytes Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: detected max file descriptor number: 2048 Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: lock engine: pthread robust mutexes Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: thunder lock: enabled Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:43:04.868947 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:43:04.908717 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: Python main interpreter initialized at 0x55c151b4f9c0 Aug 24 07:43:04.908717 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: python threads support enabled Aug 24 07:43:04.908717 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: your server socket listen backlog is limited to 100 connections Aug 24 07:43:04.908717 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:43:04.909035 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:43:04.909114 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: *** Operational MODE: preforking *** Aug 24 07:43:04.909366 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:43:04.909366 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: spawned uWSGI master process (pid: 117835) Aug 24 07:43:04.909549 dv-cinder-854274-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:43:04.910161 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: spawned uWSGI worker 1 (pid: 117836, cores: 1) Aug 24 07:43:04.911451 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: spawned uWSGI worker 2 (pid: 117837, cores: 1) Aug 24 07:43:04.911451 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:43:05.564388 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:43:05.577164 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:43:06.645571 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:06.645571 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: from cryptography.utils import int_from_bytes Aug 24 07:43:06.646137 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:06.646137 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: from cryptography.utils import int_from_bytes Aug 24 07:43:06.647721 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:06.647721 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: from cryptography.utils import int_from_bytes Aug 24 07:43:06.648141 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:06.648141 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: from cryptography.utils import int_from_bytes Aug 24 07:43:09.143656 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:43:09.144237 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:43:09.144416 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:43:09.144798 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:43:09.145077 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:43:09.145477 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:43:09.145577 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:43:09.145663 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.145752 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.145833 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:43:09.146027 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.146125 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:43:09.146340 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.146429 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:43:09.146665 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.146776 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.146971 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147060 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147286 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147373 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147598 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147687 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.147921 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148009 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148176 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148264 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148487 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148583 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148829 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-1-iscsi {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.148920 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149151 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149238 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149404 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149505 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149713 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.149808 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150031 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-1-iscsi {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150139 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150332 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150432 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150634 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150720 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.150932 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.151036 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.151242 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.151430 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.151542 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.152570 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.152739 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.152867 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153007 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153007 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153244 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153392 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153545 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153679 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153805 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.153935 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.154059 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.154182 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.154887 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155027 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155186 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155314 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155436 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155558 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155679 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155811 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-1-iscsi {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.155930 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156064 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156183 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156329 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156454 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156578 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.156845 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-1-iscsi {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157005 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157144 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157276 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157447 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157667 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157843 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.157981 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158146 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158275 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158453 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158589 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158757 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.158886 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159072 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159201 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159385 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159520 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159687 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159815 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.159984 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160191 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160330 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160466 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160591 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160745 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.160906 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161051 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161207 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161336 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161509 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161636 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161772 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.161919 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162046 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162171 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162469 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162658 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162799 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.162932 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163057 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163185 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163309 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163441 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163567 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163738 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.163868 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164053 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164184 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164322 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164457 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164581 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164765 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.164892 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165023 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165146 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165305 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165440 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165571 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165733 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.165872 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166036 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166165 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166337 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166465 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166640 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166777 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.166992 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167122 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167258 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167391 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167523 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167648 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167798 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.167931 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168106 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168258 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168420 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168557 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168747 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.168877 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169062 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169190 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169445 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169574 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169706 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.169856 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170041 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170195 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170403 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170696 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170832 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.170967 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171093 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171249 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171379 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171561 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171697 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.171876 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172010 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172176 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172304 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172428 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172552 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172724 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.172884 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173023 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173148 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173311 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173439 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173611 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173748 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.173912 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174041 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174206 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174499 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174636 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174800 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.174929 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175099 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175233 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175399 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175531 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175683 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175810 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.175973 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176098 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176268 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176403 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176566 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176733 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.176891 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177106 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177243 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177378 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177503 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177626 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177750 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.177881 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178048 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178190 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178347 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178476 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178646 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178787 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.178950 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179087 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179258 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179392 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179556 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179682 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179854 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.179983 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180159 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180287 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180461 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180589 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180782 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.180887 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181080 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181167 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181379 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181466 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181676 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181772 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.181981 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182067 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182273 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182358 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182572 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182658 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182870 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.182962 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183168 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183252 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183467 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183553 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183757 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.183866 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184055 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184157 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184354 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184441 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184667 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184755 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.184969 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185064 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185262 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185355 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185593 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185689 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.185903 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186112 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186207 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186423 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186517 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186729 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.186815 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187034 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187120 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187333 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187419 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187648 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.187734 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.187965 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.188058 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.188270 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.188356 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.188572 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.188685 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.188899 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.188987 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.189212 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:09.189300 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.189541 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.189635 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.189868 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.189960 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190174 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190258 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190498 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190596 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190807 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.190891 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191113 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191198 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191424 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191517 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191727 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.191811 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192037 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192122 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192360 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192451 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192684 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192782 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.192997 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193103 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193305 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193399 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193611 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193699 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.193922 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194006 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194244 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194337 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194555 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194640 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194862 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.194948 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195174 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195259 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195481 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195583 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195794 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.195890 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196116 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196210 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196428 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196521 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196755 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.196843 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197068 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197154 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197376 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197460 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197695 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.197794 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198016 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198102 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198323 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198407 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198628 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198721 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.198936 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199035 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199239 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199324 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199545 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199645 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199853 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.199961 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200161 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200253 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200471 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200565 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200799 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.200899 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.201647 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.201741 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.201966 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202223 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202313 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202502 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202596 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202814 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.202913 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203145 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203231 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203449 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203548 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203754 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.203861 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204054 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204186 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204360 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204457 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204685 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204856 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.204988 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205074 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205295 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205381 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205595 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205690 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205893 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.205981 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206191 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206283 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206496 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206627 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206794 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.206879 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207187 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207396 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207481 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207700 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.207791 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208005 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208089 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208306 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208398 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208609 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208708 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.208938 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209024 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209241 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209333 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209538 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209623 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209844 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.209937 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210146 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210231 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210443 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210527 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210750 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.210881 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.211056 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.211150 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.211353 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.211445 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.211665 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212018 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212227 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212318 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212527 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212613 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212860 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.212960 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213168 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213254 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213475 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213561 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213781 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.213867 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214087 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214174 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214406 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214493 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214713 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.214799 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215009 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215101 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215314 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215406 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215616 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215701 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.215917 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.216006 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.216215 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.216300 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.216521 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.216607 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.217457 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.217643 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.217774 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218012 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218099 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218339 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218437 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218645 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218739 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.218950 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219036 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219252 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219337 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219548 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219633 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219846 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.219939 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220145 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220229 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220445 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220619 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220761 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.220844 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221059 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221146 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221378 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221473 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221685 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221770 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.221984 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222069 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222281 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222379 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222579 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222673 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.222916 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223004 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223217 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223315 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223521 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223668 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223828 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.223914 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224142 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224241 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224447 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224532 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224785 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.224874 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225091 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225178 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225395 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225479 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225702 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.225787 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226007 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226095 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226305 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226396 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226616 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.226922 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227008 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227234 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227327 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227539 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227670 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227858 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.227951 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228161 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228245 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228469 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228562 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228787 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.228874 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229091 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229176 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229397 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229495 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229702 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.229787 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230013 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230097 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230316 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230410 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230625 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230710 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.230929 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231014 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231233 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231329 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231538 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231640 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231840 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.231934 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.232137 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.232229 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.232536 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.232635 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.232818 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233198 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233315 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233454 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233541 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233757 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.233843 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234076 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234236 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234382 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234508 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234686 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234772 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.234985 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235078 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235283 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235369 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235583 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235668 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235886 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.235980 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236283 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236501 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236586 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236829 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.236916 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237131 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237216 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237431 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237515 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237733 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.237825 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238029 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238113 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238325 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238409 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238626 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238712 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.238937 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239037 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239240 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239332 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239541 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239626 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239839 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.239924 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240146 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240233 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240446 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240538 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240773 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.240865 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241072 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241210 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241370 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241455 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241674 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241759 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.241973 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242066 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242283 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242367 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242595 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242689 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242893 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.242986 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243188 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243273 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243502 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243588 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243807 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.243901 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244101 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244187 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244396 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244481 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244715 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.244816 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245033 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245117 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245344 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245436 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245638 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245724 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.245940 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246026 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246246 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246331 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246630 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246848 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.246932 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247149 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247240 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247452 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247538 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247754 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.247880 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.248095 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.248190 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.248556 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.248663 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.248998 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249095 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249318 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249416 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249623 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249882 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.249968 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250211 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250303 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250523 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250609 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250830 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.250913 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251133 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251219 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251431 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251527 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251734 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.251819 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252046 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252140 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252390 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252601 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252728 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.252951 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253046 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253261 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253360 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253577 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253676 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253881 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.253987 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254183 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254284 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254481 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254568 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254782 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.254867 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255084 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255177 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255384 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255483 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255680 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255765 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.255975 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256124 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256274 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256369 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256692 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256912 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.256998 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257210 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257299 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257507 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257600 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257809 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.257894 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258109 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258404 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258497 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258698 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258791 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.258992 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259084 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259297 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259389 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259594 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259693 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259899 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.259985 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260196 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260282 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260512 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260610 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260842 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.260931 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261140 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261225 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261436 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261536 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261732 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.261818 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262041 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262132 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262428 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262645 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262744 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.262946 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.263039 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.263244 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.263330 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264077 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264170 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264389 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264625 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264762 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.264975 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265071 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265280 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265367 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265584 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265671 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265880 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.265973 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266186 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266270 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266486 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266579 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266781 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.266873 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267076 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267161 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267381 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267474 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267682 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267767 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.267978 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268110 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268274 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268360 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268567 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268713 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268886 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.268984 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269194 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269280 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269494 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269579 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269790 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.269884 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270087 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270173 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270388 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270473 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270686 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270784 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.270979 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271070 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271288 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271375 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271584 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271678 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271883 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.271970 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272177 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272268 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272472 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272568 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272790 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.272877 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273093 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273179 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273397 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273494 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273694 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273780 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.273993 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274078 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274298 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274385 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274592 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274677 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274886 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.274978 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275185 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275479 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275564 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275774 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.275859 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276069 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276156 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276371 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276502 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276686 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276793 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.276986 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277072 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277285 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277371 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277583 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277678 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277878 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.277963 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278170 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278254 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278464 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278558 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278756 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.278848 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.279050 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.279136 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280058 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280158 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280364 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280577 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280704 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.280910 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281015 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281240 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281326 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281550 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281685 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281851 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.281947 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282152 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282238 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282453 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282539 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282786 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.282880 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283086 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283385 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283470 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283684 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.283782 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284001 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284087 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284309 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284394 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284616 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284730 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.284946 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285075 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285256 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285344 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285555 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285642 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285859 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.285944 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286161 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286247 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286465 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286550 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286762 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.286855 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287061 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287147 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287364 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287459 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287669 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287754 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.287970 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288064 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288271 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288363 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288576 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288681 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.288909 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289008 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289206 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289291 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289508 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289593 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289810 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.289907 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290106 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290191 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290405 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290490 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290708 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.290806 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291006 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291092 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291309 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291402 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291607 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291731 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291910 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.291995 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292206 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292299 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292502 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292625 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292830 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.292956 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293135 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293261 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293435 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293561 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293749 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.293865 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294052 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294168 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294350 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294477 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294653 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294856 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.294989 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.295221 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.295556 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.295687 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.295934 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296047 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296359 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296454 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296686 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296778 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.296990 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297078 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297290 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297387 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297596 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297682 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297901 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.297985 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298207 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298300 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298509 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298595 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298806 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.298890 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299122 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299207 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299421 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299507 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299737 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.299822 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300086 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300172 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300385 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300471 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300701 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.300789 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301008 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301153 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301331 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301458 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301631 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301763 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.301927 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302085 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302224 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302402 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302537 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302722 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.302834 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303019 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303147 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303328 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303552 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303646 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303860 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.303953 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304159 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304252 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304540 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304634 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304877 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.304982 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305179 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305273 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305492 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305578 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305807 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.305906 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306131 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306223 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306410 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306495 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306719 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.306821 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307024 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307111 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307339 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307425 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307653 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307739 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.307957 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308043 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308267 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308353 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308566 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308678 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308905 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.308993 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309205 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309291 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309504 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309597 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309818 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.309903 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.310117 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.310224 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.310456 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.310658 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.310759 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311058 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311183 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311357 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311506 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311657 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311828 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.311962 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312131 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312263 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312429 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312578 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312759 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.312915 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313062 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313233 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313362 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313549 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313679 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313849 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.313979 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314166 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314287 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314470 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314593 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314770 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.314897 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315068 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315196 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315367 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315494 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315705 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.315806 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316005 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316100 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316407 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316663 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316770 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.316993 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317117 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317301 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317388 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317610 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317705 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.317927 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318021 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318233 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318532 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318619 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318830 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.318916 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319129 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319216 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319426 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319519 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319732 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.319818 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320031 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320117 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320330 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320417 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320628 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320766 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.320954 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321051 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321254 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321349 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321553 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321647 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321854 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.321950 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322171 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322257 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322471 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322565 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322785 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.322885 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323080 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323165 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323376 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323462 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323671 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323770 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.323967 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324052 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324261 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324346 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324565 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324679 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324885 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.324972 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325180 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325278 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325475 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325562 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325789 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.325876 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.326603 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.326702 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.326937 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327157 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327291 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327529 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327626 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327833 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.327928 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328136 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328222 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328434 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328520 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328765 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.328872 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329075 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329162 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329386 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329479 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329689 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329905 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.329992 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330230 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330323 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330541 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330636 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330851 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.330944 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331161 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331253 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331468 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331563 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331775 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.331862 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332081 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332166 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332385 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332481 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332712 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.332812 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333023 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333110 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333331 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333417 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333646 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333841 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.333977 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334162 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334322 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334472 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334580 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334780 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.334876 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335088 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335188 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335397 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335491 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335705 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.335812 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336011 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336121 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336318 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336405 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336625 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.336734 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337208 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337299 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337530 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337616 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337844 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.337939 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338163 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338250 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338467 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338552 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338775 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.338869 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339082 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339177 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339387 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339474 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339692 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339786 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.339998 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340083 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340317 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340411 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340623 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.340956 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.341043 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.341266 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.341353 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.341574 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.341734 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.342446 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.342660 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.342963 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343152 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343273 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343472 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343601 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343786 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.343924 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344095 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344244 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344405 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344556 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344741 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.344891 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345055 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345211 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345375 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345514 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345707 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.345814 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346027 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346123 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346337 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346431 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346646 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346742 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.346959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347045 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347286 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347471 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347585 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347783 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.347899 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.348112 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.348197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.348432 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.348738 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.348839 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349081 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349174 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349393 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349479 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349714 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.349810 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350032 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350118 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350330 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350424 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350630 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350716 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.350934 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351020 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351233 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351319 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351530 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351616 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351840 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.351933 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352137 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352222 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352439 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352525 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352761 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.352850 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353068 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353285 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353393 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353624 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353712 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.353934 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354082 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354234 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354329 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354554 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354640 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354855 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.354941 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355152 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355246 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355448 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355534 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355754 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.355840 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356051 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356137 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356348 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356433 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356669 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356758 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.356961 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357045 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357252 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357364 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357599 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357754 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.357903 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358162 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358256 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358466 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358553 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358775 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.358862 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359075 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359167 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359373 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359460 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359682 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359768 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.359980 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360066 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360277 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360363 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360582 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360688 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360907 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.360994 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361207 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361307 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361505 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361592 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361808 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.361894 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362114 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362210 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362412 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362506 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362716 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.362998 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363085 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363305 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363399 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363602 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363689 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.363905 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364001 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364203 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364290 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364518 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364604 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364838 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.364939 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365173 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365266 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365482 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365568 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365789 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.365929 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366182 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366399 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366493 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366704 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.366798 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367011 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367098 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367318 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367411 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367627 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367859 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.367946 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368189 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368276 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368506 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368601 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368848 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.368943 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369155 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369242 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369460 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369557 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369762 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.369848 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370059 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370151 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370376 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370473 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370682 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370769 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.370986 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371072 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371289 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371383 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371593 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371680 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371896 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.371982 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.372198 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.372290 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.372504 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.372590 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.372834 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.373434 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.373676 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.373810 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374000 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374346 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374490 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374667 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374798 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.374980 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375214 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375302 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375525 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375622 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375840 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.375964 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376155 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376242 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376462 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376563 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376828 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.376917 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377133 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377220 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377441 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377537 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377746 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.377831 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378053 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378138 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378357 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378443 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378665 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378761 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.378979 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379065 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379305 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379393 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379615 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379701 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.379913 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380007 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380213 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380325 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380518 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380635 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380856 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.380956 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381161 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381275 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381460 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381583 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381759 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.381900 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382065 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382224 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382362 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382530 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382663 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382845 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.382967 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383154 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383269 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383477 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383573 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383808 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.383939 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384130 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384218 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384426 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384525 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384748 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.384838 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385049 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385135 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385345 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385443 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385647 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385736 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.385945 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386069 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386230 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386314 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386526 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386613 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386819 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.386904 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387114 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387200 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387409 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387495 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387707 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.387795 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.388003 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.388097 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.388300 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.388387 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.389307 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.389402 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.389645 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.389808 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.389957 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390121 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390278 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390418 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390600 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390719 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.390913 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391022 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391220 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391314 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391550 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391636 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391857 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.391943 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392164 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392259 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392471 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392558 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392798 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.392933 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393099 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393196 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393403 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393496 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393769 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.393865 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394035 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394124 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394338 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394423 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394643 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394729 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.394958 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395045 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395260 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395345 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395568 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395660 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395873 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.395961 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396179 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396266 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396484 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396583 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396811 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.396900 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397116 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397202 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397422 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397519 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397725 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.397811 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398028 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398122 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398332 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398429 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398637 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398723 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.398945 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399030 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399255 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399354 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399553 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399639 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399871 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.399965 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400175 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400261 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400487 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400574 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400822 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.400910 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401131 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401220 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401453 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401539 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401758 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.401845 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402065 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402156 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402374 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402461 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402679 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402776 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.402979 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.403064 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.403223 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:43:09.403309 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.403577 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.403884 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.404250 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.404815 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.405243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.405573 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.405886 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.406212 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.406536 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.406880 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.407190 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.407532 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.407855 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.408165 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.408474 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.408805 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:09.409046 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:43:09.555319 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Registered counter for database nova_api Aug 24 07:43:09.562991 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Registered counter for database nova_api Aug 24 07:43:09.577251 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.583189 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.583788 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.589859 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.640054 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.context [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0(cell1) {{(pid=117837) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:43:09.643967 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.644386 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.645919 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.context [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0(cell1) {{(pid=117836) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:43:09.646029 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.646718 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.647159 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.649138 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.649732 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.650200 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.651084 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Registered counter for database nova_cell0 Aug 24 07:43:09.651774 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.652491 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.652948 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.655370 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.656781 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Registered counter for database nova_cell1 Aug 24 07:43:09.657342 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Registered counter for database nova_cell0 Aug 24 07:43:09.662760 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Registered counter for database nova_cell1 Aug 24 07:43:09.663793 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.666119 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.669511 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.669684 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.671713 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.676614 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.810282 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.815268 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.819660 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Registered counter for database nova_cell0 Aug 24 07:43:09.825077 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Registered counter for database nova_cell0 Aug 24 07:43:09.828870 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.833341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:09.834434 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:09.839045 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:10.234945 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:43:10.242187 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:43:10.282244 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:43:10.289479 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:43:10.587618 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:43:10.594500 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:43:10.599887 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c151b4f9c0 pid: 117837 (default app) Aug 24 07:43:10.601999 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:10.603186 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Aug 24 07:43:10.603595 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Aug 24 07:43:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:10.632698 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:43:10.639198 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-4cf8eac5-dc92-45ea-b5ab-4b9ef15bb8cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:43:10.644507 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c151b4f9c0 pid: 117836 (default app) Aug 24 07:44:32.414199 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:32.415180 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 24 07:44:32.415577 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:32.432489 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.433999 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.434945 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.436162 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.324893 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c840a5d0-fa9e-4506-a6c5-b1c2367ee063 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:33.356708 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c840a5d0-fa9e-4506-a6c5-b1c2367ee063 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934005 Aug 24 07:44:33.357472 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 24 07:44:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:35.775047 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:35.776058 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1ccd8b73-d694-48d2-a47b-0c60f753a013 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 24 07:44:35.776571 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:36.198771 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-71fd78ed-c417-41c6-b067-5bc400183a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:36.218677 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:44:36.218677 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: warnings.warn(msg) Aug 24 07:44:36.315013 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-71fd78ed-c417-41c6-b067-5bc400183a09 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.532127 Aug 24 07:44:36.316884 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:44:36.534063 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26ec1066-47c2-4a72-b2b4-ce91c02e2536 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:36.538419 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:44:36.538419 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:44:36.541107 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.541908 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.542814 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.543508 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.666697 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26ec1066-47c2-4a72-b2b4-ce91c02e2536 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341822 Aug 24 07:44:36.669009 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 24 07:44:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:39.074282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-71fd78ed-c417-41c6-b067-5bc400183a09 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:39.075297 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-71fd78ed-c417-41c6-b067-5bc400183a09 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 24 07:44:39.075709 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:39.740069 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3ea5c665-9f85-4722-aea5-0ab9e35b5953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:39.760742 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:44:39.760742 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:44:39.860197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3ea5c665-9f85-4722-aea5-0ab9e35b5953 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777471 Aug 24 07:44:39.862407 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:39.874424 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f712f2be-d8cc-4a19-a069-eacd2ddc3032 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:39.877755 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:44:39.877755 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: warnings.warn(msg) Aug 24 07:44:39.987146 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f712f2be-d8cc-4a19-a069-eacd2ddc3032 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116407 Aug 24 07:44:39.987905 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 24 07:44:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:42.366634 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3ea5c665-9f85-4722-aea5-0ab9e35b5953 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:42.367626 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3ea5c665-9f85-4722-aea5-0ab9e35b5953 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 07:44:42.368026 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:42.770861 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-96043dd7-62d7-46c0-80a4-a280c8adecd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "disk": 10}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:42.850839 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-96043dd7-62d7-46c0-80a4-a280c8adecd4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476525 Aug 24 07:44:42.851397 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:42.863575 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-291388e1-658b-42e3-abed-16dea53248d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:42.977851 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-291388e1-658b-42e3-abed-16dea53248d5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118069 Aug 24 07:44:42.978437 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 24 07:44:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:45.368527 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-96043dd7-62d7-46c0-80a4-a280c8adecd4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:45.369459 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-96043dd7-62d7-46c0-80a4-a280c8adecd4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 07:44:45.369852 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:45.792372 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f3c9236f-d7e9-4c01-acdc-f2f039f58adf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:45.867670 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f3c9236f-d7e9-4c01-acdc-f2f039f58adf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491743 Aug 24 07:44:45.868456 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:45.881176 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a90b90f-a9a9-48c7-ac73-5ed1ad2026f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:45.986990 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0a90b90f-a9a9-48c7-ac73-5ed1ad2026f2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109452 Aug 24 07:44:45.987486 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 24 07:44:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:48.448071 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f3c9236f-d7e9-4c01-acdc-f2f039f58adf admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:48.449688 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f3c9236f-d7e9-4c01-acdc-f2f039f58adf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 24 07:44:48.452948 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:48.872293 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "swap": 0, "name": "ds4G"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:48.949988 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493155 Aug 24 07:44:48.950775 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:48.963407 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7e94cf4c-d628-42ab-a510-7dd0c74f7fa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:49.077360 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7e94cf4c-d628-42ab-a510-7dd0c74f7fa2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117987 Aug 24 07:44:49.077929 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 24 07:44:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:51.695037 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:51.696098 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 24 07:44:51.696512 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:52.113304 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7cfd37f6-94a8-4b9c-9ef3-7f613ebf9ccd admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:52.137039 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7cfd37f6-94a8-4b9c-9ef3-7f613ebf9ccd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.434113 Aug 24 07:44:52.137577 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 24 07:44:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:44:54.505870 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:54.506838 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-70e00b81-ed24-4d23-bca1-0b18d943457a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 24 07:44:54.507246 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:44:54.930316 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3e2aebc7-e95f-4927-ba90-a0e68064d374 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.tiny"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:55.008771 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3e2aebc7-e95f-4927-ba90-a0e68064d374 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495296 Aug 24 07:44:55.009311 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:55.021760 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7bb32ee0-d9e9-4bf6-8f65-20f1c2de4e48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:55.140243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7bb32ee0-d9e9-4bf6-8f65-20f1c2de4e48 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122233 Aug 24 07:44:55.140813 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 24 07:44:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:57.517376 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3e2aebc7-e95f-4927-ba90-a0e68064d374 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:57.518362 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3e2aebc7-e95f-4927-ba90-a0e68064d374 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Aug 24 07:44:57.518767 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:57.925738 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-49bca689-f60c-49e0-b274-d9fdd3a9594a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:57.998858 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-49bca689-f60c-49e0-b274-d9fdd3a9594a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474100 Aug 24 07:44:57.999408 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:44:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:58.012138 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-99d8f42c-35ae-44b3-983a-fe2a9f4560ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:58.140556 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-99d8f42c-35ae-44b3-983a-fe2a9f4560ff admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132080 Aug 24 07:44:58.141253 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 24 07:44:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:00.518757 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-49bca689-f60c-49e0-b274-d9fdd3a9594a admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:00.519704 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-49bca689-f60c-49e0-b274-d9fdd3a9594a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 07:45:00.520105 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:01.011231 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e5eb51f5-98c8-4e4c-95c9-7b52ef0d88d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:01.618672 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e5eb51f5-98c8-4e4c-95c9-7b52ef0d88d2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.087378 Aug 24 07:45:01.619626 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:45:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:01.632115 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-61726b03-828b-41eb-8da1-4cd3e74d0680 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:01.733998 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-61726b03-828b-41eb-8da1-4cd3e74d0680 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105699 Aug 24 07:45:01.735005 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 24 07:45:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:04.126553 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e5eb51f5-98c8-4e4c-95c9-7b52ef0d88d2 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:04.127536 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e5eb51f5-98c8-4e4c-95c9-7b52ef0d88d2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 24 07:45:04.127931 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:04.571175 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e9278657-f2bf-41ed-b0ba-1ba8831d8d0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:04.579958 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.650411 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e9278657-f2bf-41ed-b0ba-1ba8831d8d0b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516378 Aug 24 07:45:04.652868 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:45:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:04.663454 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0d7fbbd-acaf-4956-92f5-105eb46eea95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:04.762641 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a0d7fbbd-acaf-4956-92f5-105eb46eea95 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102863 Aug 24 07:45:04.763927 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 24 07:45:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:07.172711 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e9278657-f2bf-41ed-b0ba-1ba8831d8d0b admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:07.174647 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e9278657-f2bf-41ed-b0ba-1ba8831d8d0b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003111 Aug 24 07:45:07.175213 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:07.623661 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:07.705602 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.524299 Aug 24 07:45:07.706567 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 24 07:45:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:07.718681 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-99c5822c-093a-461b-a3bb-13841e9766ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:07.843213 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-99c5822c-093a-461b-a3bb-13841e9766ba admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128307 Aug 24 07:45:07.843980 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 24 07:45:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:26.593929 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:26.594927 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 07:45:26.595326 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:26.984267 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c9d3cabb-4a44-451f-8f81-c6bb06f0468c admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:27.003259 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c9d3cabb-4a44-451f-8f81-c6bb06f0468c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401547 Aug 24 07:45:27.004410 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 24 07:45:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:28.053427 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.054409 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3779b0ff-5386-419c-8982-aeb9e44bd37b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001774 Aug 24 07:45:28.054852 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:28.576351 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-532fd0de-e6f8-4a8c-8ac2-40e4da500040 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.582041 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-532fd0de-e6f8-4a8c-8ac2-40e4da500040 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-532fd0de-e6f8-4a8c-8ac2-40e4da500040 admin admin] Request method failure captured: Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept: application/json Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept-Encoding: gzip, deflate Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Connection: keep-alive Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Content-Length: 0 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Host: 10.222.0.26 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: User-Agent: python-novaclient Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABjBdcXc8CbC1n1zuoToRhYBypDQVF9SHzTA9uTxe-VQ-XU1Ww5G9QkN0XEH7mqhG8x686S-rlUDfvfenRcI_0wqBRXVdHEIReGH3_lvKqSBz4Z2B47FnTuMrjPhn10uyZx6nyPruRkgnx6r1vJrISPbwojo8EsqlMDtGgxRj-4J-LY65E Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Name: admin Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Role: admin,member,reader Aug 24 07:45:28.585764 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Roles: admin,member,reader Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant: admin Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Name: admin Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User: admin Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Name: admin Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: method: > Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: exception: Flavor 42 could not be found. Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: action_args: {'id': '42'} Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:28.587384 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.588243 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.589526 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-532fd0de-e6f8-4a8c-8ac2-40e4da500040 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:28.590645 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-532fd0de-e6f8-4a8c-8ac2-40e4da500040 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393839 Aug 24 07:45:28.590645 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:45:28.596813 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6488abfd-70b5-404b-87c7-b799727435b3 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.601199 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.620153 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6488abfd-70b5-404b-87c7-b799727435b3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026824 Aug 24 07:45:28.620822 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:28.631229 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6de38fc2-94cd-44ae-94bc-7fed0011c265 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.654605 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6de38fc2-94cd-44ae-94bc-7fed0011c265 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027670 Aug 24 07:45:28.655132 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:28.664488 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7b822399-33a6-45b8-955b-0c75932fad3c admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.670479 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-7b822399-33a6-45b8-955b-0c75932fad3c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7b822399-33a6-45b8-955b-0c75932fad3c admin admin] Request method failure captured: Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept-Encoding: gzip, deflate Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Connection: keep-alive Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Host: 10.222.0.26 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: User-Agent: python-novaclient Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABjBdcXc8CbC1n1zuoToRhYBypDQVF9SHzTA9uTxe-VQ-XU1Ww5G9QkN0XEH7mqhG8x686S-rlUDfvfenRcI_0wqBRXVdHEIReGH3_lvKqSBz4Z2B47FnTuMrjPhn10uyZx6nyPruRkgnx6r1vJrISPbwojo8EsqlMDtGgxRj-4J-LY65E Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Name: admin Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Role: admin,member,reader Aug 24 07:45:28.673727 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Roles: admin,member,reader Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant: admin Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Name: admin Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User: admin Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Name: admin Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: method: > Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: exception: Flavor 42 could not be found. Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: action_args: {'id': '42'} Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:28.675320 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.680709 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.682096 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7b822399-33a6-45b8-955b-0c75932fad3c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:28.683434 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7b822399-33a6-45b8-955b-0c75932fad3c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014202 Aug 24 07:45:28.683434 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:45:29.649419 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6de38fc2-94cd-44ae-94bc-7fed0011c265 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:29.650413 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6de38fc2-94cd-44ae-94bc-7fed0011c265 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 07:45:29.650825 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:30.173743 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d612c93c-37e3-4795-916d-7f3acd70af9c admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:30.181706 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-d612c93c-37e3-4795-916d-7f3acd70af9c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d612c93c-37e3-4795-916d-7f3acd70af9c admin admin] Request method failure captured: Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept-Encoding: gzip, deflate Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Connection: keep-alive Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Host: 10.222.0.26 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: User-Agent: python-novaclient Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABjBdcZ9_u1TZMMnh11mqSm824RPYFjg5uZJecEzMOPUKx3m4syQvkt_hdHHGVPeVNQoa6Bf-S4qQxEItpH_756WImDlo3jlGW4140ywVExJdD7jfXqLANOPQghg6HXAZCH-4n9GjVUzoD3DvPmj1P_9-_An5hodS0aafbMRZaULFcnQ78 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Name: admin Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Role: admin,member,reader Aug 24 07:45:30.183178 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Roles: admin,member,reader Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant: admin Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Name: admin Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User: admin Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Name: admin Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: method: > Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: exception: Flavor 84 could not be found. Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: action_args: {'id': '84'} Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:30.184753 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:30.189584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.190869 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d612c93c-37e3-4795-916d-7f3acd70af9c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:30.193188 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d612c93c-37e3-4795-916d-7f3acd70af9c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397774 Aug 24 07:45:30.193188 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 24 07:45:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:45:30.195083 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-069e2163-67f8-44dd-aaee-ce3d1b4cabb8 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:30.210013 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-069e2163-67f8-44dd-aaee-ce3d1b4cabb8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019049 Aug 24 07:45:30.210539 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:30.219950 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26060a3e-2c53-447f-bfb7-d13099b14d40 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:30.235473 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26060a3e-2c53-447f-bfb7-d13099b14d40 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019143 Aug 24 07:45:30.236014 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:30.245884 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a4a9249-0a4a-4cfb-b949-f08c41cf362b admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:30.251086 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-0a4a9249-0a4a-4cfb-b949-f08c41cf362b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a4a9249-0a4a-4cfb-b949-f08c41cf362b admin admin] Request method failure captured: Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept: application/json Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept-Encoding: gzip, deflate Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Connection: keep-alive Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Content-Length: 0 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Host: 10.222.0.26 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: User-Agent: python-novaclient Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABjBdcZ9_u1TZMMnh11mqSm824RPYFjg5uZJecEzMOPUKx3m4syQvkt_hdHHGVPeVNQoa6Bf-S4qQxEItpH_756WImDlo3jlGW4140ywVExJdD7jfXqLANOPQghg6HXAZCH-4n9GjVUzoD3DvPmj1P_9-_An5hodS0aafbMRZaULFcnQ78 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Name: admin Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Role: admin,member,reader Aug 24 07:45:30.252560 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Roles: admin,member,reader Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant: admin Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Name: admin Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User: admin Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Name: admin Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: method: > Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: exception: Flavor 84 could not be found. Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: action_args: {'id': '84'} Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:30.254271 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:30.256049 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:30.257282 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a4a9249-0a4a-4cfb-b949-f08c41cf362b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:30.258286 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0a4a9249-0a4a-4cfb-b949-f08c41cf362b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011593 Aug 24 07:45:30.258286 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 24 07:45:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 07:45:31.216503 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26060a3e-2c53-447f-bfb7-d13099b14d40 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:31.217513 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26060a3e-2c53-447f-bfb7-d13099b14d40 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 07:45:31.217898 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:31.739823 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-84d65273-da95-4ea5-a760-f42784e9d605 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:31.745484 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-84d65273-da95-4ea5-a760-f42784e9d605 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-84d65273-da95-4ea5-a760-f42784e9d605 admin admin] Request method failure captured: Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept: application/json Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Accept-Encoding: gzip, deflate Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Connection: keep-alive Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Content-Length: 0 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Host: 10.222.0.26 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: User-Agent: python-novaclient Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABjBdcbblfGdi-A3-dFB05QhJYAQvpWxqXkpr_pLfGmSl1JPLQndJXLP-zu_UqEH_8H2bSSxsi_HErRWI0IVgko1_JltVvENJGEm9SExb3nZtTzaDlobcE9nGw0w1R20aGZlJ9dovo0GiwMSlUq8ui_a73Y2zf6zV8s33VN4Qx9SPe-UWM Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Project-Name: admin Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Role: admin,member,reader Aug 24 07:45:31.746959 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Roles: admin,member,reader Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant: admin Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-Tenant-Name: admin Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User: admin Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: X-User-Name: admin Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: method: > Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: exception: Flavor 451 could not be found. Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: action_args: {'id': '451'} Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:31.748546 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:31.749464 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.750508 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-84d65273-da95-4ea5-a760-f42784e9d605 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:31.751622 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-84d65273-da95-4ea5-a760-f42784e9d605 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390345 Aug 24 07:45:31.751622 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:45:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:45:31.758191 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b0d4961f-7032-48b2-9066-7479486df9c7 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:31.772980 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b0d4961f-7032-48b2-9066-7479486df9c7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018237 Aug 24 07:45:31.773495 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:31.782714 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:31.797908 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018639 Aug 24 07:45:31.798425 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 24 07:45:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:31.808093 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ac8d5ad1-6e36-4dd3-b66b-e77409071a51 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:31.813257 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-ac8d5ad1-6e36-4dd3-b66b-e77409071a51 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ac8d5ad1-6e36-4dd3-b66b-e77409071a51 admin admin] Request method failure captured: Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Accept-Encoding: gzip, deflate Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Connection: keep-alive Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Host: 10.222.0.26 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-Api-Version: compute 2.90 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: User-Agent: python-novaclient Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABjBdcbblfGdi-A3-dFB05QhJYAQvpWxqXkpr_pLfGmSl1JPLQndJXLP-zu_UqEH_8H2bSSxsi_HErRWI0IVgko1_JltVvENJGEm9SExb3nZtTzaDlobcE9nGw0w1R20aGZlJ9dovo0GiwMSlUq8ui_a73Y2zf6zV8s33VN4Qx9SPe-UWM Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Project-Name: admin Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Role: admin,member,reader Aug 24 07:45:31.814719 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Roles: admin,member,reader Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/12ef7b65bdcb4d6d980c3b5faea49511"}]}] Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant: admin Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 12ef7b65bdcb4d6d980c3b5faea49511 Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-Tenant-Name: admin Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User: admin Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Id: 7275460c8c2e486f8768d1910d8aaa60 Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: X-User-Name: admin Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: method: > Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: exception: Flavor 451 could not be found. Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: action_args: {'id': '451'} Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:31.816341 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:31.817336 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 24 07:45:31.818700 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ac8d5ad1-6e36-4dd3-b66b-e77409071a51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:31.819941 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ac8d5ad1-6e36-4dd3-b66b-e77409071a51 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011355 Aug 24 07:45:31.819941 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:45:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:45:32.792344 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:32.793390 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 07:45:32.793810 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:33.315197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a3a8346e-33b7-4c0a-8b67-af72a2235b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:33.457725 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a3a8346e-33b7-4c0a-8b67-af72a2235b7c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.523997 Aug 24 07:45:33.458197 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 24 07:45:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:34.421266 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:34.422263 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 07:45:34.422657 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:34.944745 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9c80245a-e812-4200-91ca-f82dfcbfd181 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:35.049173 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9c80245a-e812-4200-91ca-f82dfcbfd181 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.489747 Aug 24 07:45:35.049714 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 24 07:45:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:36.033831 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:36.034965 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 24 07:45:36.035361 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:45:36.558347 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bf25bebc-7b55-46a7-8b54-c4bf416c44a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:36.655720 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bf25bebc-7b55-46a7-8b54-c4bf416c44a3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.482614 Aug 24 07:45:36.656260 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 24 07:45:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:37.738870 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:37.739920 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Aug 24 07:45:37.740312 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:38.260140 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b0944048-f5f1-416d-beca-7a7196d558c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:38.338245 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b0944048-f5f1-416d-beca-7a7196d558c3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461722 Aug 24 07:45:38.338820 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 24 07:45:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:39.306527 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:39.307532 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 24 07:45:39.307929 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:39.826874 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e271019-8bbd-4863-a863-e8aaf66633e1 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:39.847878 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1e271019-8bbd-4863-a863-e8aaf66633e1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402162 Aug 24 07:45:39.848410 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Aug 24 07:45:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:33.452306 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.453268 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c5d4e16-78b9-4e51-b58f-71c7314ea7f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 07:46:33.453672 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:33.464586 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:33.842710 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3977834a-a60a-44f1-80f4-19c06a25b5dd admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.864482 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3977834a-a60a-44f1-80f4-19c06a25b5dd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404359 Aug 24 07:46:33.865038 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:33.886043 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:33.889839 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-52b62ee9-a770-4d3a-9464-7598a1885ff9 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.899187 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-52b62ee9-a770-4d3a-9464-7598a1885ff9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013647 Aug 24 07:46:33.900132 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:33.913146 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ea83218c-183c-4158-98b1-c47fe7063901 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.920836 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ea83218c-183c-4158-98b1-c47fe7063901 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011820 Aug 24 07:46:33.921356 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:33.934656 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.943728 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013002 Aug 24 07:46:33.980266 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:33.980520 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3d5f68ef-9ccf-4234-8aca-d698f277ef22 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.980520 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3d5f68ef-9ccf-4234-8aca-d698f277ef22 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012788 Aug 24 07:46:33.980520 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:49:53.045984 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:53.047251 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 07:49:53.047672 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:53.186122 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.344059 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:53.346797 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:49:53.346797 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:49:53.347912 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:53.348380 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:53.348880 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:53.349584 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:53.350020 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:53.350428 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:53.384518 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c98214d9-9676-49e3-baee-e9c4d0840514 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199929 Aug 24 07:49:53.385113 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:49:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:54.227769 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:54.228808 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Aug 24 07:49:54.229202 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:49:54.422363 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:54.424765 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:49:54.424765 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:49:54.425880 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:54.426350 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:54.426822 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:54.427490 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:54.427934 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:54.428347 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:54.447781 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-be39f8ed-f49d-4ff9-8a7f-e7ca7c1e1068 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077754 Aug 24 07:49:54.448265 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:49:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:50:05.696951 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:05.697971 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 07:50:05.698361 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:05.841722 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.842440 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.843576 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=8 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.891934 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:05.894377 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:05.894377 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:50:05.895617 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:05.896084 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:05.896501 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:05.897244 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:05.897666 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:05.898071 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:05.923997 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c9b87643-6b28-4b63-919e-533433007774 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086702 Aug 24 07:50:05.924543 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:50:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:06.754597 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:06.755598 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a6fe0aaa-1796-4d7a-8cf1-b254102f28c5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 07:50:06.755997 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 24 07:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:06.948389 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:06.950842 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:06.950842 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: warnings.warn(msg) Aug 24 07:50:06.951926 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.952402 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.953532 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.954543 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.955223 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.955815 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.978770 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b8fb4bcb-9101-4e00-a482-b5f705c174f5 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082047 Aug 24 07:50:06.979308 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 24 07:50:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:51:03.796483 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: Wed Aug 24 07:51:03 2022 - graceful shutdown triggered... Aug 24 07:51:03.797001 dv-cinder-854274-1-iscsi devstack@n-api.service[117837]: Gracefully killing worker 2 (pid: 117837)... Aug 24 07:51:03.797392 dv-cinder-854274-1-iscsi devstack@n-api.service[117836]: Gracefully killing worker 1 (pid: 117836)... Aug 24 07:51:03.801978 dv-cinder-854274-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 07:51:04.797638 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: worker 1 buried after 1 seconds Aug 24 07:51:04.797638 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: worker 2 buried after 1 seconds Aug 24 07:51:04.797638 dv-cinder-854274-1-iscsi devstack@n-api.service[117835]: goodbye to uWSGI. Aug 24 07:51:04.799121 dv-cinder-854274-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 07:51:04.799670 dv-cinder-854274-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 07:51:04.802507 dv-cinder-854274-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:51:04.811633 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:51:04 2022] *** Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: nodename: dv-cinder-854274-1-iscsi Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: machine: x86_64 Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: clock source: unix Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: pcre jit disabled Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: detected number of CPU cores: 4 Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: current working directory: / Aug 24 07:51:04.813750 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: your processes number limit is 47680 Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: your memory page size is 4096 bytes Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: detected max file descriptor number: 2048 Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: lock engine: pthread robust mutexes Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: thunder lock: enabled Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:51:04.814423 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:51:04.857646 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: Python main interpreter initialized at 0x561b736e99c0 Aug 24 07:51:04.857646 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: python threads support enabled Aug 24 07:51:04.857646 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: your server socket listen backlog is limited to 100 connections Aug 24 07:51:04.857646 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:51:04.858101 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:51:04.858101 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: *** Operational MODE: preforking *** Aug 24 07:51:04.858343 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:51:04.858343 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: spawned uWSGI master process (pid: 132870) Aug 24 07:51:04.858550 dv-cinder-854274-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:51:04.859161 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: spawned uWSGI worker 1 (pid: 132892, cores: 1) Aug 24 07:51:04.859725 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: spawned uWSGI worker 2 (pid: 132893, cores: 1) Aug 24 07:51:04.860060 dv-cinder-854274-1-iscsi devstack@n-api.service[132870]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:51:05.523053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:51:05.523663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:51:06.675492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:51:06.675492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: from cryptography.utils import int_from_bytes Aug 24 07:51:06.676131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:51:06.676131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: from cryptography.utils import int_from_bytes Aug 24 07:51:06.676555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:51:06.676555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: from cryptography.utils import int_from_bytes Aug 24 07:51:06.677011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:51:06.677011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: from cryptography.utils import int_from_bytes Aug 24 07:51:09.076814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:51:09.077511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:51:09.077511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:51:09.077930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:51:09.077930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:51:09.078065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:51:09.078143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:51:09.078233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:51:09.078233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:51:09.078372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:51:09.078668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.078769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.078859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.078933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.079188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.079297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.079493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.079603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.079951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.080064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.080271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.080633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.080866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.080982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.081942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-1-iscsi {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-1-iscsi {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.082893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.083925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.084961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.085146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.085389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.085709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.086013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.086349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.086660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.086897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.087250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.087250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.087560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.087714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.087884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.088037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.088188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.088578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-1-iscsi {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.088764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.088934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.089198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.089377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.089531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.089731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.089922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.090216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.090429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.090592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.090788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.090971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.091122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.091265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.092004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.092313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.092485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.092991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-1-iscsi {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.093902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.094946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.095879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.096868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.097029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.097481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.097638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.097790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.097942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.098991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.099866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.100919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.101972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.102891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.103464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.103619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.103771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.103771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.104050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.104200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.105881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.106848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.107004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.108879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.109764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.110912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.111954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.112890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.113034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.113509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.113673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.113829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.113980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.114886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.115921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.116925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.117804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.118273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.118426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.118577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.118780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.118947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.119990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.120142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.120294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.120437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.120728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.120893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.121942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.122874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.123030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.123174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.123730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.123896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.124993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.125919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.126069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.126222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.126373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.126524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.126667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.126811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.126811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.127102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.127320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.127470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.127657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.127804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.127957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.128440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.128602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.128805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.128962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.129106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.129263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.129408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.129563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:51:09.129714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.129864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.130887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.131979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.132971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.133136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.133294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.133470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.133955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.134127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.134344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.134580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.134741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.134894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.135832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.136004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.136155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.136315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.136466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.136615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.141933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.142891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.143041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.143197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.143356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.143516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.143668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.144955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.145886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.146995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.147981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.148955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.149115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.149275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.149534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.149926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.150896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.151121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.151370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.151540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.151702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.151852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152299 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.152996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.153156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.153307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.153477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.153628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.153777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.154856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.155971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.156122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.160054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.160369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.160544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.160757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.160930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.161998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.162992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.163912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.164071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.164230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.164381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.164555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.165996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.166930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.167861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.168871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.169034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.169184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.169333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.169541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.169803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.170192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.170378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.170621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.170780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.170940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.171973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.172965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.173923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.174092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.174282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.174437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.174680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.175999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.176170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.176322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.176485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.176671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.176874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.177963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.178901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.179888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.180067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.181092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.181268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.181422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.181658 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.181833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.182922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.183086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.183244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.183608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.183768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.183918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.184880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.185437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.185756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.185932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.186883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.187978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.188531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.188740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.188918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.189910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.190071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.190255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.190635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.190797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.191947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.192138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.192368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.192533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.192712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.192871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.193967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.194902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.195061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.195221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.195637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.195805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.195963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.196901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197376 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.197833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.198268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.198429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.198587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.198743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.198907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.199832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.200033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.200192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.200342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.201309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.201613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.201802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.202908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.203852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.204879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.205048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.205199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.205814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.205987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.205987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.206285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.206436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.206587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.206737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.206900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.207700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.208952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.209920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.210118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.210285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.210436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.210809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.210982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.211142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.211378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.211532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.211808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.211975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.212220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.212393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.212562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.212831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.212988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.213921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.214861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.215020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.215170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.215326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.215490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.215648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.216028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.216205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.216408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.217993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.218149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.218149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.218450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.218679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.218881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.219987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.220183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.220348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.220500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.220690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.221960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.222122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.222359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.222517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.222667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.222850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.223873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.224866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.225822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.226213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.226384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.226555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.227997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.228155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.228316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.228474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.228639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.229414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.229575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.229728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.229878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.229878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.230182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.230391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.230782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.231167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.231343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.231513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.231681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.231840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.232132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.232292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.232534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.232727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.232898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.233945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.234887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235658 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.235980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.236909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.237875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.238991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.239945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.240106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.240265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.240683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.240862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.241027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.241438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.241615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.241769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.242170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.242442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.242442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.242849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.243013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.243466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.243633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.243793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.243953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.244995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.245954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246376 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.246982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.247989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.248955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.249961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.250948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.251037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.251129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.251222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.251964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.252978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.253953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.254928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.255991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.256972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.257943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.258942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.259986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.260940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.261976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262299 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.262845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.263000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.263108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.263727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.263813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.263950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.264965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.265924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.266989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.267940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.268999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.269178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.269358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.269714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.269894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.270959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.271905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.272945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.273893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.274951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.275986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.276872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.277991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.278740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.279576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.279712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.279803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.279889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.279973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.280932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.281992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.282961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.283851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.284971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.285920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286618 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.286890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.287966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.288963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.289956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.290925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.291936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.292965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.293955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.294944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.295920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.296835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.297962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.298989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.299947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.300174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.300420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.300515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.300786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.300894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.301116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.301234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.301453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.301548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.301787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.302892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.303890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.304907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.305985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.306908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.307928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.308880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.309829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.310835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.311775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.312826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.313991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.314944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.315894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.316861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.317846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.318941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.319970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.320958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.321880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.322968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.323983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.324910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.325103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.325196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.325404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.325510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.326358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.326473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.326619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.326798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.326948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.327894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.328864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.329832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.330031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.330134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.330611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.330718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.330918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.331990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.332938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.333871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.334819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.335940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.336987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.337913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.338904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.339830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.340953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:51:09.341055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.341454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.342330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.342643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.342946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:51:09.343184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:51:09.402443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO dbcounter [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Registered counter for database nova_api Aug 24 07:51:09.404560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Registered counter for database nova_api Aug 24 07:51:09.423476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_db.sqlalchemy.engines [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.425059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.430401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writer thread running {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.431640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.486601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.context [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0(cell1) {{(pid=132893) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:51:09.488692 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.context [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0(cell1) {{(pid=132892) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:51:09.490676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:51:09.491151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:51:09.492739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:51:09.492847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:51:09.493213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:51:09.493493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:51:09.493941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:51:09.494788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:51:09.495535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:51:09.495915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:51:09.496026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:51:09.498440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO dbcounter [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Registered counter for database nova_cell0 Aug 24 07:51:09.498655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:51:09.501145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Registered counter for database nova_cell0 Aug 24 07:51:09.502479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO dbcounter [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Registered counter for database nova_cell1 Aug 24 07:51:09.505356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Registered counter for database nova_cell1 Aug 24 07:51:09.511682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_db.sqlalchemy.engines [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.512473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_db.sqlalchemy.engines [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.514042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.515799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.520793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writer thread running {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.522054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.522387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writer thread running {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.523698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.690061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO dbcounter [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Registered counter for database nova_cell0 Aug 24 07:51:09.690263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Registered counter for database nova_cell0 Aug 24 07:51:09.690353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_db.sqlalchemy.engines [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.690353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writer thread running {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:09.690524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:51:09.690524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:51:10.001903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: WARNING keystonemiddleware.auth_token [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:51:10.009231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: WARNING keystonemiddleware.auth_token [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:51:10.010638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:51:10.017941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:51:10.360022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: WARNING keystonemiddleware.auth_token [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:51:10.366018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: WARNING keystonemiddleware.auth_token [None req-5ba7a83a-b9bd-4120-b0eb-826b026e1c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:51:10.369052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:51:10.371273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b736e99c0 pid: 132893 (default app) Aug 24 07:51:10.375640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-44bd4722-48cd-43c9-a5ce-6e4f960dc77d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:51:10.381110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b736e99c0 pid: 132892 (default app) Aug 24 07:51:45.512818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.514759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.515767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.516950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.871096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5f2b4217-feb0-4a44-afde-f0af0cff4311 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Action: 'create', calling method: .version_select at 0x7f4568df95e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-899992042", "metadata": {"Type": "work"}}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:48.992255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5f2b4217-feb0-4a44-afde-f0af0cff4311 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.496225 Aug 24 07:51:48.993416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 24 07:51:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3499 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 07:51:49.326151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65f276ae-b116-48dc-9691-00aca942f0b6 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Calling method '.version_select at 0x7f4568f281f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:49.391868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.391868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.392699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.393536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.929808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fa893523-d4a5-4b45-97a8-186f682a71e9 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568ccc4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:50.072454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-65f276ae-b116-48dc-9691-00aca942f0b6 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92" status: 200 len: 353 microversion: 2.1 time: 1.066271 Aug 24 07:51:50.073809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:49 2022] GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 => generated 353 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:50.089285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3c43749-c35d-4925-8fe2-bce3fb0c7c69 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Calling method '.version_select at 0x7f4568d230d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:50.157369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fa893523-d4a5-4b45-97a8-186f682a71e9 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/71d40f06-81b3-4307-b87e-421624a59efe" status: 200 len: 351 microversion: 2.1 time: 0.231730 Aug 24 07:51:50.165432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:49 2022] GET /compute/v2.1/os-volumes/71d40f06-81b3-4307-b87e-421624a59efe => generated 351 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:51:50.198116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c3c43749-c35d-4925-8fe2-bce3fb0c7c69 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92" status: 200 len: 353 microversion: 2.1 time: 0.114945 Aug 24 07:51:50.199005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:50 2022] GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:51:50.213010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9ce8e93c-a904-4585-adef-afb62e507c51 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Calling method '.version_select at 0x7f4568cccc10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:50.696769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9ce8e93c-a904-4585-adef-afb62e507c51 tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92" status: 202 len: 0 microversion: 2.1 time: 0.486846 Aug 24 07:51:50.697912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:51:50 2022] DELETE /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:51:50.706945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0b16dcf-417c-439e-a0ba-c263cc31e64b tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Calling method '.version_select at 0x7f4568d23790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:50.811439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a0b16dcf-417c-439e-a0ba-c263cc31e64b tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92" status: 200 len: 352 microversion: 2.1 time: 0.108478 Aug 24 07:51:50.812013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:50 2022] GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:51.826689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b72c4fa2-961c-44f4-9929-a1b511f0df1c tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Calling method '.version_select at 0x7f4568ce7310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:52.247871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-b72c4fa2-961c-44f4-9929-a1b511f0df1c tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] HTTP exception thrown: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b72c4fa2-961c-44f4-9929-a1b511f0df1c tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Request method failure captured: Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 HTTP/1.1 Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiRhynWj4ir18OFEZpKwyFJlcEpnjEDMla36gnocKgS58FQz0kcVUtncvHzgAX8fvqRvAPsHu3Eocdr9yhiW14IGg1KlqZml0OJsdu9cTmvDxA8TEKTawTKEdTQNJmRscOZW_kS7517YdtZb3mB3BdF_a_t4qajWzgqgEwiP_uxhQo Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 8e0daa1f56f4432d880f2eb4b85391fb Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesGetTestJSON-1891378381 Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:51:52.252742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e0daa1f56f4432d880f2eb4b85391fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e0daa1f56f4432d880f2eb4b85391fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e0daa1f56f4432d880f2eb4b85391fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e0daa1f56f4432d880f2eb4b85391fb"}]}] Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesGetTestJSON-1891378381 Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 8e0daa1f56f4432d880f2eb4b85391fb Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesGetTestJSON-1891378381 Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesGetTestJSON-1891378381-project Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 39878b432b9c42a9a0e70f72cb010d75 Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesGetTestJSON-1891378381-project Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': 'be2073ac-9587-4bdd-bda9-3c08a1db4d92'} Aug 24 07:51:52.253890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. (HTTP 404) (Request-ID: req-88f61fdb-69ea-4f41-b163-11474fc9b9b9) Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:52.254637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:51:52.255698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:51:52.257023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b72c4fa2-961c-44f4-9929-a1b511f0df1c tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] Returning 404 to user: Volume be2073ac-9587-4bdd-bda9-3c08a1db4d92 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b72c4fa2-961c-44f4-9929-a1b511f0df1c tempest-VolumesGetTestJSON-1891378381 tempest-VolumesGetTestJSON-1891378381-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92" status: 404 len: 109 microversion: 2.1 time: 0.432748 Aug 24 07:51:52.261423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:51 2022] GET /compute/v2.1/os-volumes/be2073ac-9587-4bdd-bda9-3c08a1db4d92 => generated 109 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:51:52.353077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da18869b-7034-4143-98ff-d485952fba67 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568d23ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:52.571467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da18869b-7034-4143-98ff-d485952fba67 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ac69497-377e-47c4-ae37-cfeabb27acf5" status: 200 len: 350 microversion: 2.1 time: 0.222793 Aug 24 07:51:52.572685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:52 2022] GET /compute/v2.1/os-volumes/1ac69497-377e-47c4-ae37-cfeabb27acf5 => generated 350 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:54.782540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-577ff672-ec49-43e8-be86-84abdca01996 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: .version_select at 0x7f4568ce7c10>, body: {"keypair": {"name": "tempest-keypair-812510477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHFpeqLgPF7rvKTcsuNLihzmYnWAWz5xGoObJkVQCSeN16Yt1aeiRmEzrWar/XweYTaIqITak4mo1egO62ZV1JqMe+ZXUJTtC8mrgFUJTa+OERQ4Eexia7CRit5l16N3Q=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:54.845316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-577ff672-ec49-43e8-be86-84abdca01996 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:51:54.852047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-577ff672-ec49-43e8-be86-84abdca01996 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:51:54.998341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-577ff672-ec49-43e8-be86-84abdca01996 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.395018 Aug 24 07:51:55.000104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 5/9] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:51:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:51:55.084360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f9dd5905-8973-4777-a281-74ef0d8ee5d7 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568ccc430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:55.148562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f9dd5905-8973-4777-a281-74ef0d8ee5d7 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a5edf35a-81f3-40ff-9758-b5590eccbff1" status: 200 len: 351 microversion: 2.1 time: 0.068296 Aug 24 07:51:55.149454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes/a5edf35a-81f3-40ff-9758-b5590eccbff1 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:55.162065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8270e6b0-fade-4e7e-97c1-081719f57b74 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f45683c20d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:55.320165 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8270e6b0-fade-4e7e-97c1-081719f57b74 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.162145 Aug 24 07:51:55.321409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:51:55.341561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c9f46ff-06fd-4295-8f95-70930cc16e18 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568ccc9d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:55.511792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c9f46ff-06fd-4295-8f95-70930cc16e18 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.178914 Aug 24 07:51:55.511792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:51:55.545918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49d82c77-9467-4b8a-9ce1-8be3c48785b1 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f45683d5700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:55.693009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49d82c77-9467-4b8a-9ce1-8be3c48785b1 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169522 Aug 24 07:51:55.695059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:51:55.712585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-919ae844-1f97-4959-9f1e-75bfb5e45a58 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568d238b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:55.989362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-919ae844-1f97-4959-9f1e-75bfb5e45a58 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.284552 Aug 24 07:51:55.990931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:56.007129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-03d4562f-76e2-478e-a7f7-01959777c1cd tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f45683d5820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:56.214338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-03d4562f-76e2-478e-a7f7-01959777c1cd tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.213336 Aug 24 07:51:56.216405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Aug 24 07:51:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:56.229970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14cfda6a-e427-4a39-bed0-2cde4b1c16aa tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568ccc040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:56.410518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14cfda6a-e427-4a39-bed0-2cde4b1c16aa tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184501 Aug 24 07:51:56.411587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Aug 24 07:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:51:56.424193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-882b0a0d-aa45-410c-8b52-8f855508d37c tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f45683c2c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:56.543060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-882b0a0d-aa45-410c-8b52-8f855508d37c tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122769 Aug 24 07:51:56.544148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Aug 24 07:51:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:51:56.559436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2caca800-fe31-4f47-857e-9ebeec8e8c92 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] Calling method '.version_select at 0x7f4568d23af0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:56.699406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2caca800-fe31-4f47-857e-9ebeec8e8c92 tempest-VolumesTestJSON-1585516592 tempest-VolumesTestJSON-1585516592-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.146302 Aug 24 07:51:56.700126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Aug 24 07:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:51:57.004048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a13fa65b-2189-4aba-ad25-f5253ddfabf7 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Action: 'create', calling method: .version_select at 0x7f45683de700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-429176022", "metadata": {"Type": "work"}}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a13fa65b-2189-4aba-ad25-f5253ddfabf7 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 121 Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:51:57.010178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-429176022", "metadata": {"Type": "work"}}} Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: Aug 24 07:51:57.011897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-429176022', 'metadata': {'Type': 'work'}}}} Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.012857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:51:57.015666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:51:57.016809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:51:57.016809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.016809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a13fa65b-2189-4aba-ad25-f5253ddfabf7 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.017636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a13fa65b-2189-4aba-ad25-f5253ddfabf7 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.270108 Aug 24 07:51:57.022549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 10/19] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 24 07:51:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:51:57.028427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d6eba0d-45dd-4da5-adbf-0f624776ff79 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Action: 'create', calling method: .version_select at 0x7f4568cc5940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-186927129", "metadata": {"Type": "work"}}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d6eba0d-45dd-4da5-adbf-0f624776ff79 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 119 Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:51:57.037770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-186927129", "metadata": {"Type": "work"}}} Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: Aug 24 07:51:57.044887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-186927129', 'metadata': {'Type': 'work'}}}} Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi '0' Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.045507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:51:57.046761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:51:57.049045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:51:57.049045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.049045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d6eba0d-45dd-4da5-adbf-0f624776ff79 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.049045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d6eba0d-45dd-4da5-adbf-0f624776ff79 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012919 Aug 24 07:51:57.049045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 24 07:51:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:51:57.058321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-971cbd04-f18a-4360-83eb-6b9b62362f13 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Action: 'create', calling method: .version_select at 0x7f45683d5310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1363147788", "metadata": {"Type": "work"}}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-971cbd04-f18a-4360-83eb-6b9b62362f13 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 119 Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:51:57.066341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1363147788", "metadata": {"Type": "work"}}} Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: Aug 24 07:51:57.067445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1363147788', 'metadata': {'Type': 'work'}}}} Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi '' Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.068094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:51:57.069146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:51:57.070034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:51:57.070034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.070034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-971cbd04-f18a-4360-83eb-6b9b62362f13 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.084448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-971cbd04-f18a-4360-83eb-6b9b62362f13 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016423 Aug 24 07:51:57.090851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 11/21] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 24 07:51:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:51:57.095465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3672485e-3f83-4611-b984-dcfbc65f3112 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Calling method '.version_select at 0x7f4568cccc10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:57.149322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-3672485e-3f83-4611-b984-dcfbc65f3112 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] HTTP exception thrown: Volume tempest-invalid-707611107 could not be found. Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3672485e-3f83-4611-b984-dcfbc65f3112 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-707611107 HTTP/1.1 Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:51:57.153084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Volume tempest-invalid-707611107 could not be found. Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': 'tempest-invalid-707611107'} Aug 24 07:51:57.154652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-707611107 could not be found. (HTTP 404) (Request-ID: req-e4c95210-8a39-4382-9155-f48a124290b9) Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.155423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:51:57.156598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-707611107 could not be found. Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:51:57.157779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-707611107 could not be found. Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-707611107 could not be found. Aug 24 07:51:57.158927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.160734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3672485e-3f83-4611-b984-dcfbc65f3112 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 404 to user: Volume tempest-invalid-707611107 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.169808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3672485e-3f83-4611-b984-dcfbc65f3112 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-707611107" status: 404 len: 98 microversion: 2.1 time: 0.070385 Aug 24 07:51:57.169808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1215 bytes} [Wed Aug 24 07:51:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-707611107 => generated 98 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:51:57.173055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7285f1c3-47d0-40ba-8fd0-80c19b07048c tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005301 Aug 24 07:51:57.173692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Aug 24 07:51:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 07:51:57.182910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-73a0adc4-2fad-498d-a565-940c4771d9e3 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003805 Aug 24 07:51:57.183427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Aug 24 07:51:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 07:51:57.193682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de323463-c83d-4346-8c96-e16dcf738270 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Calling method '.version_select at 0x7f45683d5790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:57.253192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-de323463-c83d-4346-8c96-e16dcf738270 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] HTTP exception thrown: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de323463-c83d-4346-8c96-e16dcf738270 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/os-volumes/6275876c-dca1-495c-bf2d-b8859c76aaab HTTP/1.1 Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:51:57.255390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '6275876c-dca1-495c-bf2d-b8859c76aaab'} Aug 24 07:51:57.256797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. (HTTP 404) (Request-ID: req-214a44c5-b21b-4bf3-895b-6826b0a17771) Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.257544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:51:57.258548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:51:57.259602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. Aug 24 07:51:57.260657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.262276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de323463-c83d-4346-8c96-e16dcf738270 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 404 to user: Volume 6275876c-dca1-495c-bf2d-b8859c76aaab could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.262450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-de323463-c83d-4346-8c96-e16dcf738270 tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6275876c-dca1-495c-bf2d-b8859c76aaab" status: 404 len: 109 microversion: 2.1 time: 0.072766 Aug 24 07:51:57.263704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:51:57 2022] DELETE /compute/v2.1/os-volumes/6275876c-dca1-495c-bf2d-b8859c76aaab => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:51:57.272729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58f4d7de-6fe3-4625-840c-e529e490e5fc tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Calling method '.version_select at 0x7f4568c68040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:51:57.315370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-58f4d7de-6fe3-4625-840c-e529e490e5fc tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] HTTP exception thrown: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58f4d7de-6fe3-4625-840c-e529e490e5fc tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Request method failure captured: Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/os-volumes/4c638022-abe3-4764-a396-abf2280dd99a HTTP/1.1 Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdicetDH1PR9HQBC9OG_TthEevz2eH6hoKjbbTfNg64N-Pn1ZE7CQKxBOP_NlX_Ve-7LlkKfBoCRVl4K5ZpzF_n9ZjOMBWGzzo0H-5doB_UI-tiRHYV-ygvamW1yd04XZjnzX-DVg9SGZng05atEfHVCetHjk23_fNmOieWsmqm4sbM Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:51:57.317523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bddfa6db5d445c484e42bc05a87eeec"}]}] Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 5bddfa6db5d445c484e42bc05a87eeec Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-417471586 Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 001aa7393faa46f191a0e2fbb30e085f Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-417471586-project Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '4c638022-abe3-4764-a396-abf2280dd99a'} Aug 24 07:51:57.318785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. (HTTP 404) (Request-ID: req-cab496cd-a036-4d00-bde4-512df3e4922c) Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.319557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:51:57.320626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:51:57.322377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. Aug 24 07:51:57.324152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:51:57.328686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58f4d7de-6fe3-4625-840c-e529e490e5fc tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] Returning 404 to user: Volume 4c638022-abe3-4764-a396-abf2280dd99a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:51:57.328686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58f4d7de-6fe3-4625-840c-e529e490e5fc tempest-VolumesNegativeTest-417471586 tempest-VolumesNegativeTest-417471586-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c638022-abe3-4764-a396-abf2280dd99a" status: 404 len: 109 microversion: 2.1 time: 0.058563 Aug 24 07:51:57.328686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 07:51:57 2022] GET /compute/v2.1/os-volumes/4c638022-abe3-4764-a396-abf2280dd99a => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:51:59.389465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1056436246", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25fc9eb1-bc13-4133-b4c8-3baba837afc7"}], "security_groups": [{"name": "tempest-securitygroup--194340418"}], "key_name": "tempest-keypair-812510477", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:51:59.741073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] validate_networks() for [('25fc9eb1-bc13-4133-b4c8-3baba837afc7', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:02.661673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:02.662381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:02.662660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:02.663078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:02.663504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:02.691256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:02.691688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:02.692130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:02.694255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:02.694255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:02.694255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:02.755417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:02.759903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:02.779726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:02.794047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:03.119400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-05489f1a-93bc-40de-a2bc-00eea925123b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.736676 Aug 24 07:52:03.127222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 14/27] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:51:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:03.137034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e76ae00e-3711-4d33-a824-ecfb86b9fe5d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:03.137864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e76ae00e-3711-4d33-a824-ecfb86b9fe5d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:03.514896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-683171219", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "networks": [{"uuid": "f260dc51-40ae-42a8-80f7-719daca109ea"}]}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:03.561142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e76ae00e-3711-4d33-a824-ecfb86b9fe5d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:03.633925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e76ae00e-3711-4d33-a824-ecfb86b9fe5d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1241 microversion: 2.1 time: 0.503080 Aug 24 07:52:03.640924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] validate_networks() for [('f260dc51-40ae-42a8-80f7-719daca109ea', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:03.675392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:03 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1241 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:04.678845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a7434cf4-386d-465a-9d84-ca7084bcfed2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:04.678845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a7434cf4-386d-465a-9d84-ca7084bcfed2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:04.751471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a7434cf4-386d-465a-9d84-ca7084bcfed2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:04.761225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a7434cf4-386d-465a-9d84-ca7084bcfed2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1241 microversion: 2.1 time: 0.087348 Aug 24 07:52:04.763170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:04 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:05.286170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:05.288045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:05.288045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:05.288045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:05.288045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:05.297941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-607105617", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:05.299230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:05.299738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:05.300284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:05.301467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:05.301928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:05.302349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:05.321883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Getting quotas for project af7797a0a97b4debb3492e864b6ca1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:05.326135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Getting quotas for user a610194aaf534d3aabb56c9443b5d56d and project af7797a0a97b4debb3492e864b6ca1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:05.345286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:05.367096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:05.430547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] validate_networks() for [('6467c351-02a7-4a77-bea9-8d9b5e17596b', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:05.548083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-87d57850-ee8a-40b5-9368-7fb19eac2826 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.364630 Aug 24 07:52:05.555988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:05.587657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76fefebc-d6fa-443f-b0ee-c858c5489ad7 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:05.593696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76fefebc-d6fa-443f-b0ee-c858c5489ad7 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:06.073804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76fefebc-d6fa-443f-b0ee-c858c5489ad7 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:06.102630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76fefebc-d6fa-443f-b0ee-c858c5489ad7 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1214 microversion: 2.1 time: 0.544982 Aug 24 07:52:06.109204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:05 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1214 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:06.124055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3a31505f-1468-4f74-b365-c4efc6a0d18c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:06.130696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3a31505f-1468-4f74-b365-c4efc6a0d18c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:06.415679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3a31505f-1468-4f74-b365-c4efc6a0d18c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:06.425014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3a31505f-1468-4f74-b365-c4efc6a0d18c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1241 microversion: 2.1 time: 0.314590 Aug 24 07:52:06.428270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:06 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1241 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:07.156201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-694101df-0d46-4d04-b0dc-3b8d09c0dbea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'create', calling method: .version_select at 0x7f45682d5c10>, body: {"keypair": {"name": "tempest-keypair-916936101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEioW10M3+Dx/oac5VQKzFnO4XbGjntEwTwSJcF5P6UBlZiLqyD3wxKp2vIUevBGB39td/bETkrLcOAjl7U6ZTzfZeToeO+K03tuMKsMeslOJ7UekSFBqMWMDukri7Hrrg=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:07.239140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-694101df-0d46-4d04-b0dc-3b8d09c0dbea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:07.261128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-694101df-0d46-4d04-b0dc-3b8d09c0dbea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for user 2ec3daa674814619976aead75459e98c and project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:07.443544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-694101df-0d46-4d04-b0dc-3b8d09c0dbea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.590440 Aug 24 07:52:07.445162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 18/33] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:52:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:07.457595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-34a61b3e-5460-4261-8c11-176cad8b9000 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:07.458637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-34a61b3e-5460-4261-8c11-176cad8b9000 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:07.705406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-34a61b3e-5460-4261-8c11-176cad8b9000 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:07.713445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-34a61b3e-5460-4261-8c11-176cad8b9000 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1214 microversion: 2.1 time: 0.266217 Aug 24 07:52:07.717471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 19/34] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:07 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:07.727998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:07.737804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:07.754062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:07.757872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:07.759167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:07.760914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:07.762358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:07.763926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:07.901212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:07.901748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:07.902388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:07.902527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:07.904170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:07.938405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:07.946814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:07.948289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:07.952002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:07.952002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:07.952002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:08.056087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:08.073772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for user e23edadcfe3d4a0b81b13e278682ca2f and project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:08.109061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:08.131934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:08.133061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:08.168281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dad1e99f-0729-4149-85a3-8ef3fc9dca0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1293 microversion: 2.1 time: 0.443488 Aug 24 07:52:08.178766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 20/35] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:07 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1293 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:08.414653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ad08810-70e2-4807-b4d8-115169b0767f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.358500 Aug 24 07:52:08.421583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 16/36] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:08.440413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d42689c7-93a0-47cf-9104-d13364a60d65 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:08.441060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d42689c7-93a0-47cf-9104-d13364a60d65 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:08.647153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d42689c7-93a0-47cf-9104-d13364a60d65 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:08.654788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d42689c7-93a0-47cf-9104-d13364a60d65 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1221 microversion: 2.1 time: 0.222393 Aug 24 07:52:08.674441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 21/37] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:08 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:08.739743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:08.740367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:08.751524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:08.766228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:08.766782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:08.767726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:08.768341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:08.768962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:08.833373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1089791770", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:08.966123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] validate_networks() for [('6467c351-02a7-4a77-bea9-8d9b5e17596b', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:09.130892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:09.155043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5191e4a7-f4d2-48cf-9aed-a031ecc04fa0 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1218 microversion: 2.1 time: 0.420278 Aug 24 07:52:09.155628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 17/38] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:08 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:09.183477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:09.187682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:09.205381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:09.205921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:09.206358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:09.207134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:09.208070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:09.208675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:09.490586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:09.501237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fad9a8c6-5c9b-476c-9004-da0d9174fa60 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1311 microversion: 2.1 time: 0.321753 Aug 24 07:52:09.501824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 18/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:09 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:10.181224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:10.181224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:10.188738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:10.189440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:10.192795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:10.196962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:10.198462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:10.200306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:10.386283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:10.398303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c119d5d4-8355-4172-838f-77cd6e25fcab tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1274 microversion: 2.1 time: 0.226284 Aug 24 07:52:10.401697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 19/40] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:10 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:10.523164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:10.523881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:10.541702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:10.554823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:10.554823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:10.554823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:10.554823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:10.560802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:10.875719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:10.891935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14cd0826-e131-40b3-b9cf-d00746ddced7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1299 microversion: 2.1 time: 0.371837 Aug 24 07:52:10.894772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:10 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1299 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:11.165184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:11.166432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:11.169959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:11.173632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:11.174224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:11.186021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.186731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.187627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:11.188511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.191215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.192151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:11.260177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:11.269804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for user e23edadcfe3d4a0b81b13e278682ca2f and project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:11.285862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:11.289294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:11.423922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:11.425311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:11.447454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.448953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.449640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:11.451954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.455518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.457182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:11.461275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-51252123-3613-42ba-934a-7fd201ac0b82 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.633268 Aug 24 07:52:11.463526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:11.488413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2e3b58cf-458c-4705-bf0d-2dcf4284dad0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:11.491424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2e3b58cf-458c-4705-bf0d-2dcf4284dad0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:11.763583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2e3b58cf-458c-4705-bf0d-2dcf4284dad0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:11.788342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2e3b58cf-458c-4705-bf0d-2dcf4284dad0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1222 microversion: 2.1 time: 0.315511 Aug 24 07:52:11.793114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 23/43] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:11 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:11.873794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:11.897805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce6391f7-2c8f-427c-a6f7-904654ba833c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1272 microversion: 2.1 time: 0.477412 Aug 24 07:52:11.926122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 21/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:11 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:11.931964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:11.932836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:11.940429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.941155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.941735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:11.942664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:11.943276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:11.943843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:12.455845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:12.469080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f8ccfa5-2a9e-4964-97ad-ea304b539533 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.541716 Aug 24 07:52:12.473575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 24/45] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:11 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:12.811906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7c72d37b-177f-4049-8dc5-b015f881e348 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:12.812520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7c72d37b-177f-4049-8dc5-b015f881e348 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:12.938078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:12.938739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:12.942910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:12.955024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:12.956088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:12.959192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:12.961465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:12.962487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:12.963187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:12.967190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7c72d37b-177f-4049-8dc5-b015f881e348 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:12.974205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7c72d37b-177f-4049-8dc5-b015f881e348 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1222 microversion: 2.1 time: 0.166598 Aug 24 07:52:12.978080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 22/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:12 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:13.056219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:13.068083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e098a969-69fc-408b-8257-cc974298f378 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1272 microversion: 2.1 time: 0.134054 Aug 24 07:52:13.072692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 25/47] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:12 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:13.496364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:13.498158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:13.508279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:13.509596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:13.520310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:13.522161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:13.526177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:13.526777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:13.639485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1724971382", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c872f00-7b0e-4d56-a4cb-c524766bac52"}], "security_groups": [{"name": "tempest-securitygroup--2009009920"}], "key_name": "tempest-keypair-916936101", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:13.981181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] validate_networks() for [('6c872f00-7b0e-4d56-a4cb-c524766bac52', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:14.011351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:14.026410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2e931dd6-9b75-4bc8-a210-40549c56711e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.534679 Aug 24 07:52:14.033896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:13 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:14.074073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:14.076552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:14.102444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:14.108478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:14.109100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:14.109856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:14.110328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:14.116029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:14.304297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:14.312631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83a4266b-8e98-41cc-81c0-340f6a0e250c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1226 microversion: 2.1 time: 0.280811 Aug 24 07:52:14.314999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:14 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:14.324523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:14.326765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:14.346363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:14.351383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:14.351383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:14.351383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:14.351383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:14.351992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:14.588215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:14.597377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-15a91115-6b47-48a6-982f-8b2d7999e725 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1272 microversion: 2.1 time: 0.281092 Aug 24 07:52:14.614478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 25/50] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:14 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:15.052880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:15.053524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:15.069118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.069815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.070417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:15.071299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.071938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.072516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:15.451032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:15.473702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e2a8a964-6845-4930-9a91-0470fe29dba7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.422573 Aug 24 07:52:15.475785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:15 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:15.519187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:15.519187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:15.667087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.667087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.667087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:15.667087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.668549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.668549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:15.707613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:15.724580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aaf495a8-1aa2-411b-a033-3e4f25167115 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1274 microversion: 2.1 time: 0.246674 Aug 24 07:52:15.726213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:15 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:15.744231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:15.749101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:15.772309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.780370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.780370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:15.780370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:15.780370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:15.780990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:16.105798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:16.120548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-951ccf64-474c-44fe-a4e7-8717411f1cd5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1272 microversion: 2.1 time: 0.391582 Aug 24 07:52:16.122529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:15 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1272 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:16.501276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:16.502201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:16.573184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:16.576478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:16.577561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:16.579122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:16.580492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:16.581446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.067808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:17.080376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f2718f6b-81d6-4ea9-8c44-8036b150b1af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.585631 Aug 24 07:52:17.083616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 29/54] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:16 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:17.097160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:17.100676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:17.123866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.131238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.132328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.136730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.139705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.141726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.339104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:17.340123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:17.341655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:17.342080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:17.344343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:17.355338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=37 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:17.367508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.369075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.369718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.373118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.373949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.376340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.422303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:17.442979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:17.450878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6eca8d2f-f0b5-45ce-98f3-5c316253f2b9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1282 microversion: 2.1 time: 0.360363 Aug 24 07:52:17.452266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for user 2ec3daa674814619976aead75459e98c and project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:17.468519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:17 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1282 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:17.473938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:17.474791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:17.484853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:17.485221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.485781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.486613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.487517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:17.488175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:17.489976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:17.495130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:17.723903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:17.733698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-156f1c7d-cd7c-4710-9ff3-c3dc95f52122 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1272 microversion: 2.1 time: 0.263663 Aug 24 07:52:17.734288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 31/56] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:17 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:17.827067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-70ea2e3a-f02a-4fe1-9b45-04a0754b48af tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.192400 Aug 24 07:52:17.844432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 26/57] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:17.849617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-82f6bfaf-a031-48b6-aeb7-6e3861571cd8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:17.850232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-82f6bfaf-a031-48b6-aeb7-6e3861571cd8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:18.019304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:18.050685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-82f6bfaf-a031-48b6-aeb7-6e3861571cd8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:18.061663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-82f6bfaf-a031-48b6-aeb7-6e3861571cd8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1237 microversion: 2.1 time: 0.216025 Aug 24 07:52:18.065254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 32/58] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:17 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:18.101885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:18.102573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:18.115777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.116601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.117286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.118067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.118593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.119524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.485370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:18.485981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:18.495965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.498110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.542468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.542468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.542468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.542468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.691098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:18.702777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cbac3f6d-c1a9-4fa1-a436-c5abf1cfa763 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1280 microversion: 2.1 time: 0.226169 Aug 24 07:52:18.723448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 33/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:18 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:18.766234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:18.766234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:18.775960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.779934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.780930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.781861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:18.782481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:18.784160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:18.915584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:18.931810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-75fc1f25-7a15-4902-b242-0f6231db4780 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.834080 Aug 24 07:52:18.943448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 27/60] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:18 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:19.091939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9cae995e-57e6-44cd-ad61-822ab7f3582a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:19.093047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9cae995e-57e6-44cd-ad61-822ab7f3582a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:19.422127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:19.430475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-401de878-9baa-4a52-8596-a1cce87b9bbc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.673576 Aug 24 07:52:19.435232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 34/61] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:18 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:19.725195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:19.726102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:19.746880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:19.747423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:19.757990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:19.760159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:19.760692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9cae995e-57e6-44cd-ad61-822ab7f3582a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:19.763088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:19.763610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:19.769541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9cae995e-57e6-44cd-ad61-822ab7f3582a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1237 microversion: 2.1 time: 0.681975 Aug 24 07:52:19.784679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 28/62] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:19 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1237 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:19.784874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:19.965338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:19.966663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:20.018715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.019670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.020113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.023388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.024586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.025079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.160349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:20.174707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b6b617a3-e531-4cb9-8837-fa22e4c63b8b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1280 microversion: 2.1 time: 0.452940 Aug 24 07:52:20.177249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 35/63] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:19 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:20.686702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c73c11-2b2f-402b-854b-a59b40417d62", "tag": "9e06eb90-2417-4cb1-9633-e5840b590cb3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:20.710871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.711483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.712043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.740459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Creating event network-changed:9e06eb90-2417-4cb1-9633-e5840b590cb3 for instance e0c73c11-2b2f-402b-854b-a59b40417d62 on hv-cinder-85427 Aug 24 07:52:20.741361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:52:20.742145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-38790172-198a-4542-bac4-55a5665be320 req-739c5253-b7e2-419a-975d-7dfcbf617cec service nova] Acquired lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:52:20.743583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.747644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.748238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.751161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.752391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.754297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.779153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.compute.rpcapi [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:52:20.782649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] Releasing lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:52:20.823012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-22d47c2f-f2dd-4493-b614-e4f995087702 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438464 Aug 24 07:52:20.824698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 36/64] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:20.841095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:20.842182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:20.850443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.851111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.851678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.852592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:20.853347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:20.853907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:20.992147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:21.017749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-50153ddd-928f-4c44-a180-28d56ce0c39b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 1.057972 Aug 24 07:52:21.020585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 29/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:19 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:21.056901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:21.057762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:21.083774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:21.083774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:21.083774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:21.083774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:21.084085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:21.086116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:21.088697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:21.107725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d19d79b7-9b91-47eb-901f-fc0a97de75e9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.278467 Aug 24 07:52:21.108602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 37/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:20 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:21.186641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:21.201037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:21.201999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:21.204007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f09086e-77e5-4246-8013-58b817976951 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1289 microversion: 2.1 time: 0.177990 Aug 24 07:52:21.204942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 30/67] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:21 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:21.222641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:21.223385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:21.224192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:21.225318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:21.225940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:21.226581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:21.340376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:21.350067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-588ccf58-cef7-4ba6-9b10-2fbed6e33a78 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1280 microversion: 2.1 time: 0.154681 Aug 24 07:52:21.373165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 38/68] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:21 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:22.041158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:22.042411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:22.057109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.058487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.061195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.062329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.065118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.065741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.129873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:22.130635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:22.140149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.141479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.142067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.148568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.148568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.148568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.606761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:22.617547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3e88ec15-a224-4dcf-98a3-cc5f751c4636 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.580590 Aug 24 07:52:22.620217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 31/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:22 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:22.627288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:22.639844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:22.653854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.654322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.656753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.657641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.663346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.663816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.944850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:22.948547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:22.959868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c9521756-667f-4142-8d56-313d0fed32eb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.833699 Aug 24 07:52:22.966361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 39/70] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:22 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:22.984408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:22.985574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:22.988368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e5deb8b8-bd97-45ec-b4a8-ddc7a2619cc2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1295 microversion: 2.1 time: 0.362043 Aug 24 07:52:22.991551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 32/71] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:22 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1295 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:22.994838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.996049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:22.997633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:22.998569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:22.999258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.000530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.027343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7714f4e0-98d2-4c31-b073-0f4ee15d3252", "tag": "63cb9baf-fd09-452b-9dae-ee12a2ed54e8"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:23.067992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.068590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.069941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.124281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Creating event network-changed:63cb9baf-fd09-452b-9dae-ee12a2ed54e8 for instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 on hv-cinder-85427 Aug 24 07:52:23.124838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:52:23.125979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8b68a699-e6f9-4f39-ba68-baeb58006101 req-525cb820-bad1-4ad7-84fc-4acb75580db3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:52:23.126526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.127172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.127907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.129185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.129972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.130641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.153198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.compute.rpcapi [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:52:23.156500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] Releasing lock "compute-rpcapi-router" {{(pid=132893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:52:23.188513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b452f466-5693-43f6-9f8c-f35fe3023ae0 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179250 Aug 24 07:52:23.190539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 33/72] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:23.691111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87322eac-6f5b-4382-afab-9c669bb6b2f3", "tag": "60a4ccac-1e7f-44bd-88de-423dd82953fd"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:23.731099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.731099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.731099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.751508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] Creating event network-changed:60a4ccac-1e7f-44bd-88de-423dd82953fd for instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 on hv-cinder-85427 Aug 24 07:52:23.759170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-df739601-6658-4782-8e32-4619793b25c2 req-45c29369-118c-46fa-aa00-338918132cf8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250623 Aug 24 07:52:23.760147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 34/73] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:23.778053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:23.779965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:23.780947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:23.797411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a47b42f5-3c40-423e-a985-7c81fa0ee21c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.829591 Aug 24 07:52:23.798236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 40/74] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:22 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:23.841234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.851552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.853267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.861138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:23.861138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:23.862347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:23.988002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:23.988918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:24.002861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.003367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.003805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:24.004522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.005036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.005683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:24.388240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:24.405625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce965163-afbe-47eb-bf13-51e45216c159 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.421544 Aug 24 07:52:24.410593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 41/75] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:23 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:24.423016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:24.424488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:24.433556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.435889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.440385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:24.440385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.440385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.440385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:24.478383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:24.497736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-495e0b8e-9576-4034-ad59-e1f03d983e3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.730435 Aug 24 07:52:24.497736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 35/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:23 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:24.513732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:24.521518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a9c1414-45e2-4478-9cbf-5c1fdabca17e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1295 microversion: 2.1 time: 0.108977 Aug 24 07:52:24.522298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 42/77] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:24 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:24.820047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:24.822293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:24.829350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.830094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.830561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:24.831293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:24.831740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:24.832246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.023169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:25.036231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d4ac863-2f9b-4e21-89b5-8bc4d6e591b8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.220236 Aug 24 07:52:25.052155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 36/78] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:24 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:25.428040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:25.428661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:25.434768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.435238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.435744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.436522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.437010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.437430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.475851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccfb722-36b1-441e-b4e9-c6941f34ebf9", "tag": "c620ae12-868a-4af5-866e-99f16d6967e0"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:25.487345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.488030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.488264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.500673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] Creating event network-changed:c620ae12-868a-4af5-866e-99f16d6967e0 for instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 on hv-cinder-85427 Aug 24 07:52:25.505744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-f702ab79-8c99-48da-aaaa-4f4dc0815e6e req-d12aa225-4394-4f2e-b3ce-19d4bd49e917 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033550 Aug 24 07:52:25.506728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 37/79] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:25.515175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:25.516960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:25.523947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.524426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.524932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.531961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.532837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.533488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.606822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:25.614959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-74e22a18-8a14-4c95-89b2-d98744f77e07 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.190867 Aug 24 07:52:25.615710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 43/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:25 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:25.624130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:25.625263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:25.632189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.632678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.633113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.633845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:25.634288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:25.634714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:25.730140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:25.732270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=81 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:25.738636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf895481-d190-4939-bba0-31523cfefd15 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.228423 Aug 24 07:52:25.739942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 38/81] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:25 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:25.823638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:25.839651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7b6d625-50c1-4ffa-9f99-2ea15562d070 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.214991 Aug 24 07:52:25.839651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 44/82] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:25 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:26.059713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:26.060760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:26.067725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.069836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.069836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.069836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.069836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.070214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.218545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:26.227201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f6c57fe7-673d-477b-a19e-39759e898fe2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.172118 Aug 24 07:52:26.228025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 39/83] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:26 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:26.635249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:26.635856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:26.643159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.643637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.644066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.644776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.645325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.645637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.759662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:26.760945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:26.778139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.786956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.787652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.788442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.790248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.790586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.852418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:26.861484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e5eff222-2625-4441-9165-318f2538c188 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.229947 Aug 24 07:52:26.863267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:26 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:26.875280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:26.876195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:26.883957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.884994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.885580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:26.887989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:26.888666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:26.889296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:27.072032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:27.081698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:27.095711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8ccd746d-bd5f-4033-b5aa-e33e375b0993 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.231082 Aug 24 07:52:27.097873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-34054b13-1b66-42c7-a3ee-547b14da8cb0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.342038 Aug 24 07:52:27.112732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 46/86] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:26 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:27.113065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 40/86] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:26 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:27.251120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:27.251733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:27.258095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:27.259118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:27.259734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:27.260687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:27.261463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:27.262140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:27.421928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:27.430286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-acbb6914-ffe6-4f89-afc8-b1ce4881ccea tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.184868 Aug 24 07:52:27.430972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 47/87] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:27 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:27.884224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:27.884877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:27.902722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:27.903521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:27.913943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:27.913943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:27.913943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:27.913943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.124771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:28.127147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:28.127801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:28.129906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=14 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:28.137812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-73f65478-e2a8-4788-9c29-49bb2617ad6e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.257304 Aug 24 07:52:28.138431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 41/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:27 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:28.142611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.143109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.144222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.145091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.145680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.146235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.156415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:28.157327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:28.179395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.180253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.180906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.181777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.182529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.183098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.390835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:28.400903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0c7325fb-fbbd-4eab-a32d-79fa767792ab tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.261250 Aug 24 07:52:28.402204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 42/89] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:28 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:28.435728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:28.446192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58558d61-6623-47f1-bacb-fa91f1520123 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.329778 Aug 24 07:52:28.446338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 48/90] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:28 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:28.451507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:28.452462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:28.459795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.464748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.465990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.467266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:28.467726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:28.468140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:28.619399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:28.630857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4c361e19-ec51-46de-beb5-b176342ccd04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.182859 Aug 24 07:52:28.631766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:28 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:29.159076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:29.159686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:29.165711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.166186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.166615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.167300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.167746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.168193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.334609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:29.337278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df15979d-5953-43a1-9ba4-e99ee27036c9 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.181954 Aug 24 07:52:29.338479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 49/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:29 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:29.426556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:29.427831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:29.435310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.436117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.436261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.436963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.437404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.437820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.468752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:29.469365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:29.475480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.475957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.476381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.477090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.477530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.478031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.591832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:29.603878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bc3da0c3-b6d9-49ff-a090-82c5b02b6694 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.182394 Aug 24 07:52:29.617675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:29 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:29.634950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:29.645847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2cba7d06-ab2e-468a-8172-b5ae4bbe876d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.180987 Aug 24 07:52:29.661250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 50/94] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:29 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:29.661338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:29.661338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:29.661338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.661338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.661741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.662445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:29.662982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:29.663495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:29.766479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=7 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:29.826972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:29.835679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9a92b34b-ac2f-4a91-bcc3-5a0f051a442f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.188255 Aug 24 07:52:29.836250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:29 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:30.358349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:30.358977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:30.368198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.368713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.369342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.370224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.370843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.371547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.564794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:30.573602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7d6b5b5e-3822-42db-a385-feeae9ac8dc5 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.219138 Aug 24 07:52:30.587502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:30 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:30.627464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:30.637960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:30.645020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.645511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.645943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.646670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.647129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.647545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.673050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:30.673913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:30.678967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:30.680799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.681291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.681698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.682543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.682989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.683406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.721954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:30.774346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:30.796015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:30.804901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ea5fd0d-725d-41fa-bece-0785b131994a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.183472 Aug 24 07:52:30.805680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 46/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:30 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:30.823093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:30.832475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6634c52c-b85e-4d20-948a-7ef6ce723106 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.163048 Aug 24 07:52:30.833241 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 52/98] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:30 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:30.857802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:30.858460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:30.864895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.865699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.865816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:30.866596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:30.867184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:30.867734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.079033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:31.088390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d0d6228-1198-49d5-95fb-b0cc943d938c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.235637 Aug 24 07:52:31.089063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:30 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:31.177018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a85e76-d571-436c-a306-a993465b6854", "tag": "ea9401db-567f-4e69-9418-66ab277544ea"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:31.201189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.201189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.201189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.210832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] Creating event network-changed:ea9401db-567f-4e69-9418-66ab277544ea for instance 11a85e76-d571-436c-a306-a993465b6854 on hv-cinder-85427 Aug 24 07:52:31.217451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-aebc1674-ba8f-4c12-9030-beb8abaec988 req-57ff293b-047e-4693-8a47-69f09b68acbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044961 Aug 24 07:52:31.218343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 53/100] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:31.600140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:31.600140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:31.606588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.607278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.616784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.616784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.616784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.616784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.827506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:31.828199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:31.829878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:31.835180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.835664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.836094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.836816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.837264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.837683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.838028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7a4f9113-3967-4439-9959-1931429efe52 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.246192 Aug 24 07:52:31.838637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 48/101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:31 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:31.857062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:31.857657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:31.863474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.863946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.864372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.865086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:31.865529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:31.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:31.981218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:31.988071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4d036a83-6cbc-4dc5-aa31-9826ae0e45ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.164824 Aug 24 07:52:31.988580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 54/102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:31 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:32.005403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:32.013953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a99fc834-1b96-4970-81b2-e0ba60dad44c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.161138 Aug 24 07:52:32.014529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 49/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:31 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:32.109124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:32.109803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:32.116348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:32.116854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:32.117279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:32.118058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:32.118500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:32.118911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:32.262742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:32.270409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7cf88edf-7ab0-401e-b090-946c215cd58c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.165686 Aug 24 07:52:32.270980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 55/104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:32 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:32.859142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:32.859758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:32.866040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:32.866518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:32.867125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:32.868096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:32.868943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:32.869368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.008942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:33.011829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:33.016396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.016950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.017399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.018089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.018541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.018962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.053700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:33.065117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf8828c4-44bd-4803-a1ae-35ce2998923e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.209958 Aug 24 07:52:33.066112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 50/105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:32 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:33.077915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:33.079056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:33.085906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.086543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.087082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.087874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.088423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.088959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.140879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=10 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:33.182441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:33.191712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78bfa4ea-ed28-4727-8c26-7035bd3eeed6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.186702 Aug 24 07:52:33.197313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:33 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:33.263993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:33.279781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ab2ab2d7-1b9e-4cfc-aa5d-a40a2fa602f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.211920 Aug 24 07:52:33.280701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:33 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:33.293508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:33.294201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:33.300567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.301196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.306363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.306363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:33.306363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:33.306363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:33.450115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:33.463933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b46b826-ceab-49a5-b3be-4b60d801adff tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.176277 Aug 24 07:52:33.464551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:33 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:34.107766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:34.109057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:34.115703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.116369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.117098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.117951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.118552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.119119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.213506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:34.214714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:34.221674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.222398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.222993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.224052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.224680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.225248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.384354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:34.393681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fc07ff43-5121-459a-8db2-c49589694647 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.184211 Aug 24 07:52:34.394282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 58/109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:34 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:34.398955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:34.399554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:34.405802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.406487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.406920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.407615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.408079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.408494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.569102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:34.578803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bd83c1ff-eb53-45ff-a0d5-747556525d56 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.183167 Aug 24 07:52:34.579657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 59/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:34 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:34.602728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:34.603648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:34.610674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.611437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.611954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.612915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:34.613558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:34.614155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:34.763032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:34.776021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e8f5bfd8-81d2-48a9-8f6d-72d8d1024ae9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.176956 Aug 24 07:52:34.776732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 60/111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:34 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:34.779874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:34.787664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9e57f9c4-fcda-430b-b6e5-b1792295943e tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.701588 Aug 24 07:52:34.790840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 52/112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:34 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:35.425492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:35.428873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:35.438471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:35.441549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:35.441549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:35.441549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:35.441549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:35.442107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:35.892694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:35.904148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3460dee8-37bb-4582-939d-d01e6b69fcf1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.491709 Aug 24 07:52:35.904964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:35 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:35.912311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:35.914975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:35.923153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:35.923964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:35.924556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:35.925469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:35.926057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:35.926612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.180089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c73c11-2b2f-402b-854b-a59b40417d62", "name": "network-vif-plugged", "status": "completed", "tag": "9e06eb90-2417-4cb1-9633-e5840b590cb3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:36.198100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:36.209728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:36.210522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.229213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] Creating event network-vif-plugged:9e06eb90-2417-4cb1-9633-e5840b590cb3 for instance e0c73c11-2b2f-402b-854b-a59b40417d62 on hv-cinder-85427 Aug 24 07:52:36.239720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-72c3de00-ba16-4279-97ed-ca9d0df8622d req-5d0bd76d-71f1-4cdb-818c-077aba8ebd17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.828901 Aug 24 07:52:36.240554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 61/114] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:36.257381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:36.258580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:36.279929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:36.280421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:36.280876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.282108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:36.282572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:36.282990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.947297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:36.949171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:36.959536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee13b57b-274f-4bcc-9f24-50fd1118a897 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.714389 Aug 24 07:52:36.961322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 62/115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:36 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:36.974246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:36.975477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:36.979911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-18777baf-d85b-4abd-bc52-9c68db36246f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 1.071543 Aug 24 07:52:36.983348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 54/116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:35 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:36.984220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:36.984924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:36.985504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.986354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:36.987371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:36.987948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:36.999469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:37.000390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:37.014268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:37.016066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:37.018645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:37.021799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:37.022856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:37.024936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:37.056135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:37.274166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:37.286316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-478bd715-9f63-4e5f-97c6-783853908a80 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.323932 Aug 24 07:52:37.286905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 63/117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:36 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:37.442691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:37.455021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3ac6188a-7241-491a-95f4-7aea44b8f969 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.466681 Aug 24 07:52:37.455021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 55/118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:36 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:37.982819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:37.983420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:37.990805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:37.991952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:37.992767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:37.994431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:37.995169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:37.995770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.008112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:38.008112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:38.016310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.021195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.021747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.022586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.023137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.023654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.173300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:38.174801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:38.181339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6cf1a06b-522e-4266-bb3e-bff06bf83d87 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.202589 Aug 24 07:52:38.181914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 64/119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:37 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:38.184439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-646f1e02-69f7-498b-807b-ed14fcd69931 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.183405 Aug 24 07:52:38.185287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 56/120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:37 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:38.311792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:38.312433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:38.318617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.319087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.319515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.320193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.320666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.321075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.337121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87322eac-6f5b-4382-afab-9c669bb6b2f3", "name": "network-vif-plugged", "status": "completed", "tag": "60a4ccac-1e7f-44bd-88de-423dd82953fd"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:38.347845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.348332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.348781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.364117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] Creating event network-vif-plugged:60a4ccac-1e7f-44bd-88de-423dd82953fd for instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 on hv-cinder-85427 Aug 24 07:52:38.370077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-5cd1da07-6157-4f37-818b-7f2f1b714daa req-2121a087-edbb-401f-bc1b-2175e40b5581 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Aug 24 07:52:38.370978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 57/121] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:38.462424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:38.471052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dc7bf25e-2aa4-47e9-9184-48da95e9bb5f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.163770 Aug 24 07:52:38.517225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 65/122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:38 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:38.517716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:38.517716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:38.517716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.517716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.518280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.518280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:38.518280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:38.518280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:38.639564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:38.647182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b46ae1d3-3c41-4a49-9d63-73b672f9ca1d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.176900 Aug 24 07:52:38.647744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 58/123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:38 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:39.203947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:39.206140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:39.207219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:39.207849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:39.214327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.214615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.216148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.216364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.216941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.217112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.217899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.218130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.218611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.218901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.219217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.220030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.377710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:39.385657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7591b496-1a21-4314-9976-ee2820b89d98 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.187279 Aug 24 07:52:39.386346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 66/124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:39 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:39.392866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:39.400626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ad7eba1e-da32-49df-b778-c61946839cf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.198889 Aug 24 07:52:39.401204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 59/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:39 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:39.540143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:39.541003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:39.551042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.551730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.552398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.554303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.554965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.556061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.667492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:39.669138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:39.684868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.685613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.688007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.691381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:39.692327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:39.697976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:39.753759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:39.764153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-82df0dab-7e9e-44f6-9d29-a240f0d4d942 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.230006 Aug 24 07:52:39.772095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 67/126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:39 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:39.931819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:39.940313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5593baca-12d6-4bf6-8ddd-5ae3dde11cdc tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.276801 Aug 24 07:52:39.940933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 60/127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:39 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:40.387903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7714f4e0-98d2-4c31-b073-0f4ee15d3252", "name": "network-vif-plugged", "status": "completed", "tag": "63cb9baf-fd09-452b-9dae-ee12a2ed54e8"}, {"server_uuid": "3ccfb722-36b1-441e-b4e9-c6941f34ebf9", "name": "network-vif-plugged", "status": "completed", "tag": "c620ae12-868a-4af5-866e-99f16d6967e0"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:40.401264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.401264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.401264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.407560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:40.413497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:40.417803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.419943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.420536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.421470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.422070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.422661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.429807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Creating event network-vif-plugged:63cb9baf-fd09-452b-9dae-ee12a2ed54e8 for instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 on hv-cinder-85427 Aug 24 07:52:40.430310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] Creating event network-vif-plugged:c620ae12-868a-4af5-866e-99f16d6967e0 for instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 on hv-cinder-85427 Aug 24 07:52:40.439553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-6462f2d2-ad1d-423a-ab85-69432c93f12c req-96442c25-6ce8-4d74-9a0d-2e7ebf14fb68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056215 Aug 24 07:52:40.442258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 68/128] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:40.445767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:40.446449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:40.454200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.455082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.455649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.456476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.457085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.457655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.581388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:40.591580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ad99304-995a-489b-baa7-56779f218990 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.188972 Aug 24 07:52:40.592809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 61/129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:40 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:40.644491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:40.652354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d5885ae6-32e3-4467-8781-e8c994e3d336 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1366 microversion: 2.1 time: 0.210738 Aug 24 07:52:40.653370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 69/130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:40 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:40.795341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:40.795951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:40.802262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.802753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.803173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.804822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.804822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.804822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.959549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:40.961854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:40.962575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:40.968091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7a77bde9-45e2-46d2-b939-d76b7588a30b tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.177071 Aug 24 07:52:40.968721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 62/131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:40 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:40.969394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.969878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.970345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:40.971069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:40.971518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:40.971938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.250430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:41.256387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.261326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b3619b50-9da4-4fda-90a5-2883ef1a507f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.304272 Aug 24 07:52:41.262958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 70/132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:40 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:41.612978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:41.616135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:41.619952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.620428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.620968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.621684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.622132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.622547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.674042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:41.674666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:41.698125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.698624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.699603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.706740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.707237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.707673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.954771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:41.967237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-05a44a2b-7f84-4f22-a291-196e006f3a32 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.358209 Aug 24 07:52:41.971054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:41.983091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 63/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:41 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:41.985512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44039fdd-94b8-42a1-9820-7352254c4999 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1557 microversion: 2.1 time: 0.315955 Aug 24 07:52:41.987477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 71/134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:41 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1557 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:41.998308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:41.999115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:42.012892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.013698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.017170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.018623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.019168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.019691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.024909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:42.025588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:42.034856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.035513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.035964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.036932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.037843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.038293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.213081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cf4f1f73-3cd5-4a24-952e-b91c6a2e17be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196536 Aug 24 07:52:42.214792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 72/135] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:52:42 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:42.278056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:42.282987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:42.283592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:42.290153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-37d842fd-d477-4b31-87ba-ed4bdcc578b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.304658 Aug 24 07:52:42.291683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.291802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.292079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 64/136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:41 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:42.292271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.293501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.294129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.294700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.637036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:42.662178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c777be7-5de3-493c-b8d3-0d579729bb3d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.382476 Aug 24 07:52:42.663282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 73/137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:42 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:42.994288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:42.994897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:43.001887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.002527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.003183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.004063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.004679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.005255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.278552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:43.287094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e12d5ed-f720-4eca-8fa0-d4e5e6a8d229 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.296794 Aug 24 07:52:43.301324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 65/138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:42 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:43.313391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:43.314971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:43.324838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.327844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.327844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.327844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.327844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.328308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.570220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:43.582273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b15f8a33-01d1-4b15-a453-b52c175302a2 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.270948 Aug 24 07:52:43.583277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 74/139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:43 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:43.684245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:43.685295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:43.691632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:43.693499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.694229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.694870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.695934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.696599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.697215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.905341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c73c11-2b2f-402b-854b-a59b40417d62", "tag": "9e06eb90-2417-4cb1-9633-e5840b590cb3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:43.911232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:43.916158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.916938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.929254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.929396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-32ff53a6-6fa1-4e34-b06a-eab115118821 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.248019 Aug 24 07:52:43.932821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] Creating event network-changed:9e06eb90-2417-4cb1-9633-e5840b590cb3 for instance e0c73c11-2b2f-402b-854b-a59b40417d62 on hv-cinder-85427 Aug 24 07:52:43.942229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 66/140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:43 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:43.943512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e96d2f5c-54c4-4fea-8290-5bb13d7d18dd req-3e4faef2-e730-475e-ad62-ad4b34d375eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042156 Aug 24 07:52:43.944299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 75/141] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:44.308448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:44.309485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:44.315906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.316615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.317128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.317877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.318624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.319217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.607297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:44.608045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:44.623675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.624330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.625880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.627842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.628512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.631618 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.693807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:44.704532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fc7d3d40-995c-4a2d-9318-4a95e2e03e54 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.400715 Aug 24 07:52:44.722752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 67/142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:44 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:44.873025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:44.888997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ea71df23-7d91-4c1d-a0e2-63a3df89686f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.289124 Aug 24 07:52:44.901823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 76/143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:44 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:44.952138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:44.952778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:44.962302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.962788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.963315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.964406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.965079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.965827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.249939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:45.262606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf4d9955-6e64-40cf-b30d-5f9bce24191e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.315425 Aug 24 07:52:45.265626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 68/144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:44 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:45.303266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a85e76-d571-436c-a306-a993465b6854", "name": "network-vif-plugged", "status": "completed", "tag": "ea9401db-567f-4e69-9418-66ab277544ea"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:45.318548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.319088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.319572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.339112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] Creating event network-vif-plugged:ea9401db-567f-4e69-9418-66ab277544ea for instance 11a85e76-d571-436c-a306-a993465b6854 on hv-cinder-85427 Aug 24 07:52:45.358293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-be430efb-a776-4704-b9a0-93a47ea96d51 req-c1525e6c-78da-436d-ba11-688a0b05c79d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051459 Aug 24 07:52:45.358293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 77/145] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:45.727764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:45.729131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:45.741706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.746376 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.747199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.753875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.753875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.753875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.912175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:45.912896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:45.932798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.933233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.934305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.935165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.935632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.940191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:46.025567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:46.033962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6bd0a81-1588-48ce-9b73-6ebf0ec8b9df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1322 microversion: 2.1 time: 0.310475 Aug 24 07:52:46.035013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 69/146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:45 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:46.091106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:46.098883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83db7901-f13e-4b6c-8d27-896b1237f35f tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1314 microversion: 2.1 time: 0.191019 Aug 24 07:52:46.099561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 78/147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:45 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:46.286606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:46.287816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:46.293947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:46.294418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:46.294943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:46.295849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:46.296287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:46.296906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:46.455001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:46.462583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e90fa0d9-871e-4dc7-8487-b8c5a11f3c7c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.180135 Aug 24 07:52:46.463147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 70/148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:46 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:47.054384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:47.055046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.061366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.061833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.062282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.062957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.063503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.064035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.120888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:47.121758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.129661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.130416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.130998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.131914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.132585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.133176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.229687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:47.239211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25e88e79-6d30-470c-b584-51e7127fcab7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1517 microversion: 2.1 time: 0.188493 Aug 24 07:52:47.255840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 79/149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:47 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:47.261407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:47.263674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.269838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.270703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.271208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.271975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.272441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.272891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.300486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'flavor' on Instance uuid 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:52:47.419471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:47.435616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a16e566e-d2fd-4e4a-8db4-ea1145fff25a tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1501 microversion: 2.1 time: 0.318371 Aug 24 07:52:47.450913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 71/150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:47 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:47.484218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:47.497373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.497373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.497373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.497373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.498061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.498061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.498061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.584574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2643a65b-1822-41bf-a2a5-fe5dbe9b2fb0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9/action" status: 200 len: 32 microversion: 2.1 time: 0.326680 Aug 24 07:52:47.585541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 80/151] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:52:47 2022] POST /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:52:47.614189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1805253592", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "networks": [{"uuid": "a05c9cfa-1bfb-4d7e-94d4-917497366181"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:47.675515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] validate_networks() for [('a05c9cfa-1bfb-4d7e-94d4-917497366181', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:47.712723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:47.744904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:47.752260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e12371e2-3d95-4531-90c6-8ce5a5e7e22c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.272621 Aug 24 07:52:47.768594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 72/152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:47 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:47.773747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:47.778184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.790924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.794334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.794877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.795685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.796595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.799388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:48.202841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:48.203404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:48.203745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:48.204119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:48.204976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:48.214412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:48.215605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:48.216380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:48.217143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:48.217587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:48.218008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:48.237646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Getting quotas for project 4decf63db0594949b321e3450a122100. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:48.242986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Getting quotas for user 83fa9e38ff6d4620aae391266c82fa1c and project 4decf63db0594949b321e3450a122100. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:48.272120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:48.274816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:48.303231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:48.319792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0743f745-566b-4028-b7ec-2d40c0f46568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.549543 Aug 24 07:52:48.328928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 73/153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:47 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:48.410904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b5fc1b85-85bb-4817-ad53-1325f59ee44a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823758 Aug 24 07:52:48.411733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 81/154] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:48.424883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76f92d99-6e75-407a-b9bb-e180df2b32ca tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:48.424883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76f92d99-6e75-407a-b9bb-e180df2b32ca tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:48.555151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76f92d99-6e75-407a-b9bb-e180df2b32ca tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:48.570098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76f92d99-6e75-407a-b9bb-e180df2b32ca tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1214 microversion: 2.1 time: 0.151096 Aug 24 07:52:48.570748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 74/155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:48 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:48.787271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:48.787910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:48.795212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:48.795795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:48.796331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:48.797097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:48.797544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:48.797958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:48.949362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:48.960406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a10638c8-7521-4c79-8288-09abac9e1f79 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1363 microversion: 2.1 time: 0.177217 Aug 24 07:52:48.961033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 82/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:48 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:49.360560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:49.361329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:49.367769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.368498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.369272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.370141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.370641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.371704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.401646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97c4f9d9-9d50-4555-95eb-bb4610eb9c59"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:49.405815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:49.412533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.413201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.413782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.414697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.415394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.416006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.533417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:49.545427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3f935355-9759-4c9d-9231-359f256c478d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.190094 Aug 24 07:52:49.546222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 75/157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:49 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:49.592327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-95bb14e9-5034-418d-995d-e2ed27d4068b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:49.596965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-95bb14e9-5034-418d-995d-e2ed27d4068b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:49.649612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-95bb14e9-5034-418d-995d-e2ed27d4068b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:49.658115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-95bb14e9-5034-418d-995d-e2ed27d4068b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1214 microversion: 2.1 time: 0.070556 Aug 24 07:52:49.658894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 76/158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:49 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:49.981391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:49.982363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:49.988620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.989132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.989556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.990401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.990851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.991263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.147403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:50.155766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a8863740-a7ef-4fe6-b3d1-e7c7cdd62002 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1549 microversion: 2.1 time: 0.178626 Aug 24 07:52:50.156532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 77/159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:49 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:50.181354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:50.182150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:50.189745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.190564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.191146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.192040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.192657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.193243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.362663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-00f07bcb-1953-4332-b63c-b2d1f17a41ea tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186468 Aug 24 07:52:50.364509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:52:50 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:50.549218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-41a34a6d-e760-4e1b-a139-1320127f83bc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "POST /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151086 Aug 24 07:52:50.551762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 83/161] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:52:49 2022] POST /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252/os-volume_attachments => generated 194 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:50.586852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:50.586852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:50.594324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.594815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.595246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.595941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.596390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.596834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.684764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:50.685823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:50.693155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.693986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.694412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.695117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.695555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.695965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.807717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:50.816391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-50e706b5-31cb-4261-928b-65c2290ce66f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.246479 Aug 24 07:52:50.829547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 79/162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:50 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:50.890960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:50.900697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0381390c-19e9-433c-8ecb-780b30a0c6e2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1210 microversion: 2.1 time: 0.225002 Aug 24 07:52:50.902654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:50 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:51.754903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a85e76-d571-436c-a306-a993465b6854", "tag": "ea9401db-567f-4e69-9418-66ab277544ea"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:51.797098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.799318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.800811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.816521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] Creating event network-changed:ea9401db-567f-4e69-9418-66ab277544ea for instance 11a85e76-d571-436c-a306-a993465b6854 on hv-cinder-85427 Aug 24 07:52:51.825083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-e61d8fd2-33f8-4614-98ed-3d15ab2c095f req-d42da16b-ee06-4c3d-90df-377c4790ea8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075195 Aug 24 07:52:51.829848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 80/164] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:52:51.838722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:51.839660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:51.858074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.858669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.859177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.860035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.860613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.861255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.929185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:51.932071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:51.940012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.941127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.941861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.942858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.944112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.944865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:52.044408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:52.053603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-11273270-f278-444e-bdea-3956ef36c377 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1274 microversion: 2.1 time: 0.131080 Aug 24 07:52:52.054184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 81/165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:51 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:52.063133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:52.075442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-237a2b9e-3fac-4bf9-b2fa-1cde84abdcc0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.240657 Aug 24 07:52:52.092577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:51 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:53.076488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:53.077255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:53.087496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.088238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.093380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.093380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.093380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.093380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.102663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:53.105054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:53.120031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.124968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.126397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.128966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.130472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.132163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.165154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:53.345174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:53.354235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-93aaa10b-13f0-4e2f-82a4-d5a30a57f08b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.258340 Aug 24 07:52:53.355647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:53 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:53.373516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:53.381692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eb7bd460-5566-4c2b-be21-0ef7a0eb9b53 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1272 microversion: 2.1 time: 0.309819 Aug 24 07:52:53.382268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 82/168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:53 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:54.385561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:54.386169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:54.393255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.393715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.394148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.395637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.396096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.396520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.407767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:54.408375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:54.427419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.427909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.428341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.429102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.429551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.429972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.595855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:54.604235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-53d1a2cd-7639-46e3-871c-28886db8715d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.223316 Aug 24 07:52:54.605361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 87/169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:54 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:54.623608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782e973d-b009-45da-8c19-025e90935ee7", "tag": "be67e56b-ccff-427e-a8e0-d853f184af16"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:54.634984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.635957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.637447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.656768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:54.662291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] Creating event network-changed:be67e56b-ccff-427e-a8e0-d853f184af16 for instance 782e973d-b009-45da-8c19-025e90935ee7 on hv-cinder-85427 Aug 24 07:52:54.666185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc698407-d0e0-4283-a18f-2377eddfdd2c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.262735 Aug 24 07:52:54.674660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-4fcca89c-ed50-4edc-a638-e0c22d3053ba req-19366e8f-3c39-4e15-acf3-14387465f00e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061172 Aug 24 07:52:54.674660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 88/171] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:54.674945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 83/171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:54 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:55.625727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:55.626445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:55.634062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:55.634716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:55.635135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:55.635824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:55.636304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:55.636915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:55.693448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:55.694764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:55.702069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:55.702893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:55.703360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:55.704051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:55.704944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:55.705362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:55.793618 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:55.803481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3a05c364-8651-4fa1-a682-35bed7405395 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.182436 Aug 24 07:52:55.810779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 89/172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:55 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:55.854285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:55.864125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd2457d1-9fdd-4935-9172-d792ce996663 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.177464 Aug 24 07:52:55.864783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 84/173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:55 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:56.827105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:56.827846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:56.835385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.835889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.836417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.837323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.837876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.838300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.884572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:56.885199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:56.891646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.892112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.892535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.893279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.893717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.894123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.990206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:57.005588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a2391ad8-ae00-4725-b8c5-39fe133abaa9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.180368 Aug 24 07:52:57.006463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 90/174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:56 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:57.060479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:57.068247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1ccf7ac6-b3aa-4a15-a400-678101a45686 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.187450 Aug 24 07:52:57.068858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 85/175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:56 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:58.028453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:58.029035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:58.035565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.036044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.036507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.037227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.037673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.038193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.091133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:58.091821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:58.103390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.103866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.104290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.106550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.106550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.106738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.186877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:58.206283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5607d2e1-1fe0-4fb1-882b-d30f740ae4eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.182515 Aug 24 07:52:58.206933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 91/176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:58 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:58.279281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:58.287340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc0eaf1c-062d-4d26-b60e-fa41b99e57d2 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.200835 Aug 24 07:52:58.291709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 86/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:58 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:59.227539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:59.228794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:59.232635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:59.243318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:59.243318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.243318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.243318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.243839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.243839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.243839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.309799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:59.311046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:59.316977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.317451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.318176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.319017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.323711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.323711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.387881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:59.398747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f75947a0-822c-4896-9064-2e197bc05336 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.175194 Aug 24 07:52:59.399565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 92/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:59 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:59.482502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:59.493108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3b0f2ebd-2d7f-4e69-aa62-3f6ab46c1833 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.187227 Aug 24 07:52:59.493811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 87/179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:59 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:00.420897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:00.421504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:00.430140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.430646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.431027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.431718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.432164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.432580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.514390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:00.515745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:00.517836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=4 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:00.522894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.524699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.524699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.524699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.525626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.525626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.594113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:00.602647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4c028fc-ed6a-44c1-9b59-06f14a92ba34 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.186734 Aug 24 07:53:00.603551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 93/180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:00 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:00.669663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:00.677492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-791d9b6b-7aa2-48f5-9bbd-a4476e82e4db tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.167905 Aug 24 07:53:00.678061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 88/181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:00 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:01.294164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782e973d-b009-45da-8c19-025e90935ee7", "name": "network-vif-plugged", "status": "completed", "tag": "be67e56b-ccff-427e-a8e0-d853f184af16"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:01.311108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.311588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.312018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.323308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] Creating event network-vif-plugged:be67e56b-ccff-427e-a8e0-d853f184af16 for instance 782e973d-b009-45da-8c19-025e90935ee7 on hv-cinder-85427 Aug 24 07:53:01.328629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-9281255b-a811-4412-9d66-1420734b786c req-cf5b6266-09b9-4b5b-a340-6fbf173c8bb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051848 Aug 24 07:53:01.329595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 94/182] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:01.466860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:01.467349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:01.474436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.476163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.476163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.476163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.477125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.477563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.503135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:53:01.625526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:01.626214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:01.629465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:01.632969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.634543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.634543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.634543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.634954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.635375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.798261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:01.810721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0a1ed7a-7592-4be8-9c37-4b89cee0d933 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.189680 Aug 24 07:53:01.811772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 95/183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:01 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:01.821053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:01.824535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:01.832878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.833641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.834111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.834814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.835266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.835684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.863795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-baa252ac-b05f-4256-b65e-0b320bb724e3 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 204 len: 0 microversion: 2.1 time: 0.401383 Aug 24 07:53:01.865784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 89/184] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:53:01 2022] DELETE /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:53:01.879561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:01.880411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:01.887988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.888509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.889240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.890076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:01.890827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:01.891526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:01.993501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:02.003013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d4121e8-b26d-465d-8ffd-2c7a256802fb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.185552 Aug 24 07:53:02.004208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 96/185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:01 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:02.036346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:02.038652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:02.045627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7eaeb50d-7c27-4a92-b711-ba377bcb6714 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1553 microversion: 2.1 time: 0.170543 Aug 24 07:53:02.046407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 90/186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:01 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:02.833425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:02.834059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:02.840495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:02.841007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:02.841932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:02.842706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:02.843148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:02.843589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:02.978886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:02.987357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d912b3db-c0ec-412a-b346-01a15251137c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.158741 Aug 24 07:53:02.987912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 97/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:02 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:03.025464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:03.025985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:03.033562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.034048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.034478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.035167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.035620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.036039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.067036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:03.067614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:03.076573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.077163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.077601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.078337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.078884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.079545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.179644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:03.189114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b612d506-f737-4002-85b8-4902c987773a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.167327 Aug 24 07:53:03.189695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 91/188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:03 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:03.225038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:03.233448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44ca8db7-dc52-4206-ae2d-340a029bb3af tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1553 microversion: 2.1 time: 0.170215 Aug 24 07:53:03.234024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 98/189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:03 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:04.008123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:04.008777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:04.014651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.015130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.015562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.016257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.016735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.017157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.149541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:04.158203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ddc67e6a-13dd-4014-ae49-24e1caca81f0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.154054 Aug 24 07:53:04.158767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 92/190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:04 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:04.210376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:04.210974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:04.218341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.218873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.219336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.220417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.220614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.221075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.254524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:04.255044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:04.261968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.262439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.262861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.263796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.264500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.264940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.358851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:04.366847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7d021a9-36b8-480a-91be-8248a0b23740 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.160269 Aug 24 07:53:04.367516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 99/191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:04 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:04.402418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:04.411584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-572d99c0-767e-496f-9a7f-e740b4540573 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1553 microversion: 2.1 time: 0.160984 Aug 24 07:53:04.412156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 93/192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:04 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:05.179260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:05.179867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:05.186433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.186835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.187271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.187948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.188394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.188845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.334622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:05.344256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c13407d6-37d4-41fe-8cf5-ccc5afa12e3e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.168841 Aug 24 07:53:05.345511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 100/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:05 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:05.387199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:05.387883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:05.394105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.394661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.395155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.395992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.396322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.396768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.441095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:05.441693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:05.447528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.448794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.448794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.449185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.449630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.450044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.565242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:05.573500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f00041da-1c47-46d8-9fe5-b9cb1f8ff0eb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1314 microversion: 2.1 time: 0.190084 Aug 24 07:53:05.574082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 94/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:05 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:05.627293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:05.635933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ccc1e0f-161a-4d4c-8320-8624987d9a2d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1553 microversion: 2.1 time: 0.198756 Aug 24 07:53:05.636508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 101/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:05 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:06.365650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:06.366518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:06.374416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.375196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.375623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.376328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.376815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.377229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.594690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:06.596354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:06.606541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.607321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.608348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.609338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.609786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.610203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.706434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:06.723479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-07e0ea71-15a3-4097-af42-48e266270e1d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.360827 Aug 24 07:53:06.725534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 95/196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:06 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:06.730912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:06.731839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:06.744674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.751646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.751646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.751646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.751646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.752012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.784320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:06.794210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-95d26ae5-204f-462e-a0fc-955ebd35e818 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1499 microversion: 2.1 time: 0.203806 Aug 24 07:53:06.796040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 102/197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:06 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:06.933470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:06.946682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1631dd15-83f4-44fd-9c0f-a55120022e63 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1553 microversion: 2.1 time: 0.219662 Aug 24 07:53:06.947308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 96/198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:06 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:07.032858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7714f4e0-98d2-4c31-b073-0f4ee15d3252", "name": "network-vif-deleted", "tag": "63cb9baf-fd09-452b-9dae-ee12a2ed54e8"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:07.043711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.044251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.046024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.064196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] Creating event network-vif-deleted:63cb9baf-fd09-452b-9dae-ee12a2ed54e8 for instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 on hv-cinder-85427 Aug 24 07:53:07.070219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-f1a76c35-9a88-4e60-89df-5154f369e701 req-a753d414-dfff-4fe5-acaa-2b41fe286826 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041854 Aug 24 07:53:07.071117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 103/199] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:07.750590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:07.750590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:07.754791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.755632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.756082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.756796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.757252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.757675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.872342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:07.873711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:07.881338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.881990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.882596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.883690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.884281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.885025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.917004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:07.926633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6cc3afc5-ad53-4e07-8c28-0b177ad6e2b2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.182762 Aug 24 07:53:07.927451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 97/200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:07 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:07.928257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:53:07.957892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:07.969703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:07.970393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:07.977130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.977606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.978056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.978740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.979181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.979593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.021986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.022484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.022891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.023342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lazy-loading 'fault' on Instance uuid 7714f4e0-98d2-4c31-b073-0f4ee15d3252 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:53:08.068260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:08.077775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b5136f45-9362-4882-843b-1f91bffea4b1 tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1350 microversion: 2.1 time: 0.112597 Aug 24 07:53:08.078353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:07 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:08.251834 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-06b0f785-918a-4566-bd46-9c22860b95b6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "DELETE /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 204 len: 0 microversion: 2.1 time: 0.383200 Aug 24 07:53:08.252430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 104/202] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:53:07 2022] DELETE /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:53:08.260663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:08.261408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:08.268289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.268982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.269443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.270137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.270618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.271038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.407864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:08.415666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3886f7c6-4140-4fa3-9bdb-860b105a6064 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1505 microversion: 2.1 time: 0.158958 Aug 24 07:53:08.416232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 99/203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:08 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:08.948616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:08.949276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:08.956111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.956584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.957036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.957718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.958160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.958571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.090739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:09.099775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:09.100465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7781fd84-4395-4927-a996-5a731262b0eb tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.156106 Aug 24 07:53:09.100617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:09.101065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 105/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:08 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:09.106634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:09.107104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:09.107535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.108212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:09.108914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:09.109337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.138553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:09.139015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:09.139432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.140420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lazy-loading 'fault' on Instance uuid 7714f4e0-98d2-4c31-b073-0f4ee15d3252 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:53:09.180539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a610194aaf534d3aabb56c9443b5d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7797a0a97b4debb3492e864b6ca1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:09.188970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7b3d3f3d-f144-4552-ac9f-0bc07345d5cc tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 200 len: 1350 microversion: 2.1 time: 0.093070 Aug 24 07:53:09.189532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 100/205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:09 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:09.438321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:09.438917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:09.444990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:09.451542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:09.451542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.451542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:09.451542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:09.451886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:09.587013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:09.596310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c6d7f977-c25d-4838-ba39-becebadbee6a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1505 microversion: 2.1 time: 0.162414 Aug 24 07:53:09.596926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:09 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:10.120492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:10.121132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:10.127348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.127802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.128235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.128951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.132395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.132395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.209756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:10.210355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:10.216706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.217363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.218975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.220785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.221233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.221647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.236587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] HTTP exception thrown: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Request method failure captured: Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 HTTP/1.1 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiiqYJzcVco7SQGJuWqV-dOq3ZkjKd2TQ55bXkchwkdaBIECyOVHvVL4EzaEsBH8SC7arxUPzLopLmQcORWBBlG7JzE5O-2E6ePkP8n1QM8vM4dp6b0VCPy4QLYKeb99B1RMdEeGDfJdZZIQIGz1aEAI4Ok2YB2PJ-Xw8rqU8d6ojY Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:53:10.241186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}] Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: a610194aaf534d3aabb56c9443b5d56d Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.242411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '7714f4e0-98d2-4c31-b073-0f4ee15d3252'} Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:10.243098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.244244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.245364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Returning 404 to user: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:10.245364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dc71294d-9249-4991-ac17-3e122d77487c tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 404 len: 111 microversion: 2.1 time: 0.036711 Aug 24 07:53:10.251701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 107/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:10 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:53:10.323147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:10.336831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ce4d5476-07ca-4f4a-84d3-04086488b514 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.216938 Aug 24 07:53:10.336831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 101/208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:10 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:10.424214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:10.426527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:10.433858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.434379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.434988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.435684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.436805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.437344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.454721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] HTTP exception thrown: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Request method failure captured: Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252/os-volume_attachments HTTP/1.1 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiiqYJzcVco7SQGJuWqV-dOq3ZkjKd2TQ55bXkchwkdaBIECyOVHvVL4EzaEsBH8SC7arxUPzLopLmQcORWBBlG7JzE5O-2E6ePkP8n1QM8vM4dp6b0VCPy4QLYKeb99B1RMdEeGDfJdZZIQIGz1aEAI4Ok2YB2PJ-Xw8rqU8d6ojY Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:53:10.456286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}] Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: a610194aaf534d3aabb56c9443b5d56d Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.457472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '7714f4e0-98d2-4c31-b073-0f4ee15d3252'} Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:10.458162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:10.462728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:10.464261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Returning 404 to user: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:10.464261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-880f73a7-a8e9-46d4-8e98-c24df4c0b8fb tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049909 Aug 24 07:53:10.464261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 108/209] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:53:10 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:53:10.621110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:10.621110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:10.626640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.627345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.627835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.628581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.629261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.629758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.073093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:11.083989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-29d4d8ca-2326-4db8-a049-4c02d01e830a tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1505 microversion: 2.1 time: 0.470652 Aug 24 07:53:11.084857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 102/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:10 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:11.104067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782e973d-b009-45da-8c19-025e90935ee7", "name": "network-vif-deleted", "tag": "be67e56b-ccff-427e-a8e0-d853f184af16"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:11.115945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.115945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.115945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.129117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] Creating event network-vif-deleted:be67e56b-ccff-427e-a8e0-d853f184af16 for instance 782e973d-b009-45da-8c19-025e90935ee7 on hv-cinder-85427 Aug 24 07:53:11.134124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-ffe1f287-832d-44a5-bd64-a09e7a276ea9 req-7fb4354b-10c2-4204-b552-d37a7938142d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034647 Aug 24 07:53:11.134740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 109/211] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:53:11.368576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:11.369210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:11.376604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.377112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.377540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.378241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.378685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.379103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.538805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:11.548518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6320197-8556-4629-a43f-055721b79e5e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.183616 Aug 24 07:53:11.548769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 103/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:11 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:11.833318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:11.833881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:11.840741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.841213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.841639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.842318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.842767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.843181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.863038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] HTTP exception thrown: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Request method failure captured: Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 HTTP/1.1 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiiqYJzcVco7SQGJuWqV-dOq3ZkjKd2TQ55bXkchwkdaBIECyOVHvVL4EzaEsBH8SC7arxUPzLopLmQcORWBBlG7JzE5O-2E6ePkP8n1QM8vM4dp6b0VCPy4QLYKeb99B1RMdEeGDfJdZZIQIGz1aEAI4Ok2YB2PJ-Xw8rqU8d6ojY Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:53:11.864798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}] Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: a610194aaf534d3aabb56c9443b5d56d Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.865941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '7714f4e0-98d2-4c31-b073-0f4ee15d3252'} Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:11.866604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.867961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.869413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Returning 404 to user: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:11.869413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ffb3159-f974-40d7-b784-58fe64bae17d tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 404 len: 111 microversion: 2.1 time: 0.038077 Aug 24 07:53:11.869413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 110/213] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:53:11 2022] DELETE /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:53:11.875880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:11.876683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] [instance: 7714f4e0-98d2-4c31-b073-0f4ee15d3252] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:11.898650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.899128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.899549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.900236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.900686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.901102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.923897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] HTTP exception thrown: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Request method failure captured: Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 HTTP/1.1 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiiqYJzcVco7SQGJuWqV-dOq3ZkjKd2TQ55bXkchwkdaBIECyOVHvVL4EzaEsBH8SC7arxUPzLopLmQcORWBBlG7JzE5O-2E6ePkP8n1QM8vM4dp6b0VCPy4QLYKeb99B1RMdEeGDfJdZZIQIGz1aEAI4Ok2YB2PJ-Xw8rqU8d6ojY Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:53:11.929001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/af7797a0a97b4debb3492e864b6ca1b1"}]}] Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: af7797a0a97b4debb3492e864b6ca1b1 Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-DeleteServersTestJSON-758986439 Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: a610194aaf534d3aabb56c9443b5d56d Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-DeleteServersTestJSON-758986439-project Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.930425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '7714f4e0-98d2-4c31-b073-0f4ee15d3252'} Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:11.931241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. Aug 24 07:53:11.932520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:11.933753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] Returning 404 to user: Instance 7714f4e0-98d2-4c31-b073-0f4ee15d3252 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:11.933753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc723b76-cb8e-434b-aa66-b2a8315ed9cd tempest-DeleteServersTestJSON-758986439 tempest-DeleteServersTestJSON-758986439-project] 10.222.0.26 "GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252" status: 404 len: 111 microversion: 2.1 time: 0.058722 Aug 24 07:53:11.933753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 104/214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:11 2022] GET /compute/v2.1/servers/7714f4e0-98d2-4c31-b073-0f4ee15d3252 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:53:12.105341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:12.106236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:12.114058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.114781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.115439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.116323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.116958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.117563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.194778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.195501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.196074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.196826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lazy-loading 'fault' on Instance uuid 782e973d-b009-45da-8c19-025e90935ee7 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:53:12.280221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:12.290817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ffa4aae3-b797-4a0a-bffc-fab74f2b03af tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 200 len: 1304 microversion: 2.1 time: 0.188686 Aug 24 07:53:12.291402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 111/215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:12 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:12.569546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:12.570142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:12.576255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.576763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.577185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.578478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.579524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.580015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.727995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:12.737066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-de1612a7-0c30-46fb-9af0-2eea8c1983c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.171391 Aug 24 07:53:12.737897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 105/216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:12 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:13.321099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:13.321099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: 782e973d-b009-45da-8c19-025e90935ee7] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:13.324726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.325361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.325938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:13.326781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.327376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.328590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:13.344310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] HTTP exception thrown: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Request method failure captured: Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 HTTP/1.1 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdjM_gz2eLvLmJuGcEJbqYLI-YjyS6iOXfnsHE_OCjheZyyhTvJM8pjcmcQoR0aaotG7CpMKQ3EUgui2fa6v92TCjnlZQqtbldSaIlqNQgDbtUQgP_IIf9zKf4XrDeFA9-OKwTCwkmFi0EUv_B1HlKWhK9SFJvBPa5EbjD7rlIaAFHQ Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 4decf63db0594949b321e3450a122100 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:53:13.346007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4decf63db0594949b321e3450a122100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4decf63db0594949b321e3450a122100"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4decf63db0594949b321e3450a122100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4decf63db0594949b321e3450a122100"}]}] Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 4decf63db0594949b321e3450a122100 Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesActionsTest-1379634553-project Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 83fa9e38ff6d4620aae391266c82fa1c Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesActionsTest-1379634553-project Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. Aug 24 07:53:13.347280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '782e973d-b009-45da-8c19-025e90935ee7'} Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:13.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. Aug 24 07:53:13.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:13.351285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Returning 404 to user: Instance 782e973d-b009-45da-8c19-025e90935ee7 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:13.352321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ebf594f-2404-42e4-920d-5afaa5aee340 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7" status: 404 len: 111 microversion: 2.1 time: 0.044956 Aug 24 07:53:13.353073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 112/217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:13 2022] GET /compute/v2.1/servers/782e973d-b009-45da-8c19-025e90935ee7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:53:13.479422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2049551731", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "networks": [{"uuid": "a05c9cfa-1bfb-4d7e-94d4-917497366181"}]}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:13.628687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] validate_networks() for [('a05c9cfa-1bfb-4d7e-94d4-917497366181', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:53:13.758859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:13.759548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:13.766349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.771318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.771318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:13.771318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.771318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.771785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:14.022059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:53:14.022748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:53:14.023777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:53:14.024248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:53:14.025096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:53:14.042093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:14.045539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:14.046235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:14.049732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:14.050835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:14.057966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:14.068203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:14.070414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Getting quotas for project 4decf63db0594949b321e3450a122100. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:53:14.076155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:14.077062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Getting quotas for user 83fa9e38ff6d4620aae391266c82fa1c and project 4decf63db0594949b321e3450a122100. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:53:14.077953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24d3d03e-b377-4a13-baa3-fc21ba3aa18d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.322789 Aug 24 07:53:14.078509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 113/218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:13 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:14.094685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:53:14.097189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:53:14.302747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-368f3629-5dd1-4c4f-b49f-74c5ed4d2ac6 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827646 Aug 24 07:53:14.306719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 106/219] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:53:14.319135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46b9ee07-6e81-4b69-bf65-c44ebc644095 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:14.320156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-46b9ee07-6e81-4b69-bf65-c44ebc644095 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:14.403896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46b9ee07-6e81-4b69-bf65-c44ebc644095 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:14.414119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46b9ee07-6e81-4b69-bf65-c44ebc644095 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1214 microversion: 2.1 time: 0.100019 Aug 24 07:53:14.415347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 114/220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:14 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:15.099317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:15.100377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:15.106955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.110486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.110486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.110486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.110486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.110821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.252456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:15.262002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dd390ad1-db46-4947-9fef-4d36a0fb0c64 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.166925 Aug 24 07:53:15.262719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 107/221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:15 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:15.437695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:15.438911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:15.448398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.449518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.450614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.470574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.470574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.472374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.791607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:15.806763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ffed1770-0111-4d37-9c7a-aa52c333aa04 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1218 microversion: 2.1 time: 0.373981 Aug 24 07:53:15.808285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 115/222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:15 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1218 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:16.285107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:16.286365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:16.302482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.303041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.303648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:16.304353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.304845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.305273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:16.309539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:16.559100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:16.567391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c3f74fa-a539-40fd-b9e9-a0262dce58df tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.287611 Aug 24 07:53:16.567964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 108/223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:16 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:16.829460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:16.830088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:16.836401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.836908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.837340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:16.838013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.838458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.838867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:17.050439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:17.058640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e17cc2e7-2671-4158-8bd2-c851eb24c858 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1266 microversion: 2.1 time: 0.233942 Aug 24 07:53:17.059282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 116/224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:16 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:17.589250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:17.589852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:17.596462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:17.596997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:17.597430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:17.598145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:17.598600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:17.599585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:17.807969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:17.818761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-edc03c01-32d5-4de4-98f0-3cdfd4fdb234 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.233914 Aug 24 07:53:17.834181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 109/225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:17 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:18.080394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:18.081157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:18.088658 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:18.089157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:18.089588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:18.090271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:18.090717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:18.091127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:18.246884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:18.259796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca64073f-396f-46c6-a8ce-4635783bdfb8 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.183680 Aug 24 07:53:18.274010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 117/226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:18 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:18.841886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:18.842710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:18.850250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:18.850875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:18.851413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:18.852308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:18.852891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:18.853550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.014055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fc438f-93a3-42ad-afca-903bd782e62b", "tag": "77b90000-ae91-448d-8aac-505c4ea98144"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:19.023750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:19.024297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:19.024850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.036136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] Creating event network-changed:77b90000-ae91-448d-8aac-505c4ea98144 for instance f3fc438f-93a3-42ad-afca-903bd782e62b on hv-cinder-85427 Aug 24 07:53:19.041965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-467473d1-9b97-4188-b162-aceb57def735 req-51f7a381-35c0-4d28-8a9c-1c893342ab8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031241 Aug 24 07:53:19.043057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 118/227] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:53:19.043509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:19.054017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec7bf7e3-c09a-4c0e-9437-0fd9d8b0e9a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.217204 Aug 24 07:53:19.054607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 110/228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:18 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:19.285150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:19.285856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:19.295450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:19.295952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:19.297061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.299500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:19.299500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:19.299500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.441242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:19.452637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84c4828f-f682-4bdb-8068-7ca958001afb tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.172732 Aug 24 07:53:19.453389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 119/229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:19 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:20.090333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:20.090333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:20.098770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.099534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.099993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.101568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.102182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.103424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.252546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:20.260296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fefbd729-61a6-4b26-866d-d0c453548e29 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.180403 Aug 24 07:53:20.260893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 111/230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:20 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:20.473723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:20.474335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:20.480540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.481060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.481494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.482180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.482655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.483287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.644078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:20.655226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-51db89d0-49e2-4cc7-bec6-e44890318fef tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.185395 Aug 24 07:53:20.656402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 120/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:20 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:21.282656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:21.283596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:21.289717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.290184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.290610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.291338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.291778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.292187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.421021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:21.428827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-426d6420-5a6e-4791-8aaf-15b7e3dd2640 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.150892 Aug 24 07:53:21.429418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 112/232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:21 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:21.676144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:21.677018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:21.686435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.687364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.687949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.695695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.695695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.695695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.857085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:21.865997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-99525f32-4562-4216-8ed8-0859fb58aa7c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.194401 Aug 24 07:53:21.866579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 121/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:21 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:22.453722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:22.455261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:22.461905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.462374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.462798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:22.463480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.463916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.464322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:22.604215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:22.612982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d7a3ab9-6337-493e-9998-bf7e848d8ff8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.167247 Aug 24 07:53:22.613650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 113/234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:22 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:22.887370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:22.887957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:22.895306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.895781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.896209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:22.896919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.897366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.897782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:23.037163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:23.044868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-411e5a2a-f5d4-4f57-abbd-feeb0dca9eea tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.161417 Aug 24 07:53:23.045431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 122/235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:22 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:23.634009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:23.634622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:23.640613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:23.641116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:23.641534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:23.642360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:23.642798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:23.643271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:23.786725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:23.794614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1a6c06b6-ddd6-459c-97f6-25ced567289f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.164782 Aug 24 07:53:23.795195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 114/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:23 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:24.067212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:24.067897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:24.074516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.075054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.076204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.076204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.076596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.077037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.217944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:24.226841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-750e6774-3abc-40ba-ae2a-38a0ab53e841 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.165167 Aug 24 07:53:24.227818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 123/237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:24 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:24.817516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:24.818197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:24.821734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:24.822417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:24.825963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.826698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.827330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.828021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.828469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.829709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.961749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:24.970377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8cbaea47-9e10-4f3a-be37-c255e8de1a6d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.156565 Aug 24 07:53:24.971522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 115/238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:24 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:25.248401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:25.249074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:25.251865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:25.257247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:25.257717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:25.258145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:25.258818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:25.259258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:25.259668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:25.394565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:25.397740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:25.402559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3270f052-5ebe-4ad6-ad66-d211042a489b tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.158005 Aug 24 07:53:25.403141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 124/239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:25 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:25.993994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:25.995465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:26.002808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.003439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.003927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.004664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.005111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.005527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.142989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:26.151160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6b2ba6f3-b618-4ce7-9b03-2f52dca5b33e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.162837 Aug 24 07:53:26.151946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 116/240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:25 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:26.424895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:26.426111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:26.435491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.436001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.436633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.441754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.441754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.441754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.609503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:26.622758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5b101072-266e-43dc-967f-2e9767c0b079 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.203021 Aug 24 07:53:26.623338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 125/241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:26 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:27.174052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:27.174754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:27.180193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:27.180692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:27.181125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:27.181800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:27.183413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:27.183413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:27.324519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:27.333447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-73eb01ce-ba5f-4593-91f1-cbe64ac833b0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.163968 Aug 24 07:53:27.334545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 117/242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:27 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:27.591140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fc438f-93a3-42ad-afca-903bd782e62b", "name": "network-vif-plugged", "status": "completed", "tag": "77b90000-ae91-448d-8aac-505c4ea98144"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:27.606606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:27.607058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:27.607479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:27.618620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] Creating event network-vif-plugged:77b90000-ae91-448d-8aac-505c4ea98144 for instance f3fc438f-93a3-42ad-afca-903bd782e62b on hv-cinder-85427 Aug 24 07:53:27.623365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e24c168f-4576-4033-860a-d836d2d83caf req-c3a4e314-42a1-42d9-a611-40557d0ec9d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Aug 24 07:53:27.624438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 126/243] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:27.646265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:27.647075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:27.653536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:27.659597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:27.659597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:27.659597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:27.659597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:27.660129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:28.092854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:28.098270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-040f80f2-acf6-45d8-9b1e-4f912248f8b9 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.457379 Aug 24 07:53:28.098855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 118/244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:27 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:28.355762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:28.356486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:28.362891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:28.363358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:28.363784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:28.364464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:28.364952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:28.365351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:28.503804 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:28.511705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae3195a1-5365-449b-9308-fed87aa86d59 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.160177 Aug 24 07:53:28.512268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 127/245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:28 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:29.121171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:29.121632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:29.130030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.131783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.131783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.136187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.136187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.136187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.305986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:29.313731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f814578b-9c3c-40b4-b86c-ccfa6ee10b41 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1314 microversion: 2.1 time: 0.197463 Aug 24 07:53:29.314422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 119/246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:29 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:29.532629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:29.533957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:29.540449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.540958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.541393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.542090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.542542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.542991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.676935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:29.685247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca5c2a2f-5276-4618-a8b3-3097889a6ab5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.156447 Aug 24 07:53:29.702792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 128/247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:29 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:30.335034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:30.335642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:30.342036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.342514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.342944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.343630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.344086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.344524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.488076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:30.498073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7fed9180-7340-46d4-8fae-bb65204dde20 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1498 microversion: 2.1 time: 0.166768 Aug 24 07:53:30.499167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:30 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:30.708623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:30.709346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:30.716102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.716615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.717104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.717819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.718262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.718670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.853052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:30.860842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-32396ebf-4323-42a9-a76e-4905532ff52a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.157817 Aug 24 07:53:30.861759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 129/249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:30 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:31.565363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:31.566121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:31.572606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.573175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.574274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.574524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.575026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.575369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.605098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:53:31.882631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:31.883510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:31.890458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.890987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.891409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.892119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.893076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.893581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:32.005712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72669a99-439c-4c3a-9f04-b49bd0b714ce tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 204 len: 0 microversion: 2.1 time: 0.444549 Aug 24 07:53:32.006398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 121/250] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:53:31 2022] DELETE /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:53:32.015307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:32.015923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:32.022362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:32.022833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:32.023254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:32.024259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:32.024918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:32.025383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:32.058141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:32.066844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-47df77e6-9afa-424f-bdcb-ed16aaa3e99c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.188181 Aug 24 07:53:32.067427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 130/251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:31 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:32.172359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:32.182754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-133468ec-0634-4f24-bce0-360fe5aa206f tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1504 microversion: 2.1 time: 0.171658 Aug 24 07:53:32.183522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 122/252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:32 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:33.088378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:33.089305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:33.092096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:33.097650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.098131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.098725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.099686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.100784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.101248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.206938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:33.207522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:33.214288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.214998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.215578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.216328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.216800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.217212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.225825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:33.267387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:33.290592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c6aecb6f-2195-49e9-9e08-82dba692c2f8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.206063 Aug 24 07:53:33.295565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:33 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:33.493824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:33.502400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-763e96da-68c8-43e5-99d5-6a169aa35ae3 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1504 microversion: 2.1 time: 0.299798 Aug 24 07:53:33.502972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:33 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:34.315930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:34.316544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:34.323904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.324556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.325109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.325977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.326529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.327045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.482411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:34.494318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d77bb6eb-21ba-4edb-83a7-a421bacc7b04 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1523 microversion: 2.1 time: 0.182754 Aug 24 07:53:34.496316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 132/255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:34 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:34.523757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:34.524353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:34.534815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.535338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.535772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.536745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.536960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.537376 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.811088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:34.818912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-51f38702-168b-4163-8c67-3feb876707c0 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1504 microversion: 2.1 time: 0.299546 Aug 24 07:53:34.819524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 124/256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:34 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:35.258639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fc438f-93a3-42ad-afca-903bd782e62b", "name": "network-vif-deleted", "tag": "77b90000-ae91-448d-8aac-505c4ea98144"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:35.269168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.269637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.270330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.285826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] Creating event network-vif-deleted:77b90000-ae91-448d-8aac-505c4ea98144 for instance f3fc438f-93a3-42ad-afca-903bd782e62b on hv-cinder-85427 Aug 24 07:53:35.299495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-0b5b63c0-d8fd-4bb0-9436-9247553d1988 req-0555dcd9-af79-46d9-b792-fedebcf4188c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037769 Aug 24 07:53:35.299495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 133/257] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:53:35.521224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:35.521926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:35.540846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.541944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.542559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.544087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.544766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.547717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.743329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:35.750960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-01bd92c7-c996-4c6e-abce-deb578efdd77 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1503 microversion: 2.1 time: 0.234240 Aug 24 07:53:35.752060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 125/258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:35 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:35.772368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:35.773802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:35.780321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.780838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.781268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.781955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.782401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.782861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.840040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:35.840653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:35.847202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.849953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.849953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.849953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.849953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.850308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.931083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa9e38ff6d4620aae391266c82fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4decf63db0594949b321e3450a122100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:35.942611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e50ff99-2477-41d4-97cb-4260be43213c tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 200 len: 1299 microversion: 2.1 time: 0.106231 Aug 24 07:53:35.943211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 126/259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:35 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:35.989536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:35.997697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-18b3cace-68d7-45e2-9931-00b91d6cded6 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1516 microversion: 2.1 time: 0.230160 Aug 24 07:53:35.998272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 134/260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:35 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:36.966345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:36.966940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] [instance: f3fc438f-93a3-42ad-afca-903bd782e62b] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:36.974187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:36.974737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:36.975241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:36.975993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:36.976437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:36.976885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:36.990301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] HTTP exception thrown: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Request method failure captured: Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b HTTP/1.1 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdjM_gz2eLvLmJuGcEJbqYLI-YjyS6iOXfnsHE_OCjheZyyhTvJM8pjcmcQoR0aaotG7CpMKQ3EUgui2fa6v92TCjnlZQqtbldSaIlqNQgDbtUQgP_IIf9zKf4XrDeFA9-OKwTCwkmFi0EUv_B1HlKWhK9SFJvBPa5EbjD7rlIaAFHQ Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 4decf63db0594949b321e3450a122100 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:53:36.991941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4decf63db0594949b321e3450a122100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4decf63db0594949b321e3450a122100"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4decf63db0594949b321e3450a122100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4decf63db0594949b321e3450a122100"}]}] Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 4decf63db0594949b321e3450a122100 Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesActionsTest-1379634553 Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesActionsTest-1379634553-project Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 83fa9e38ff6d4620aae391266c82fa1c Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesActionsTest-1379634553-project Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. Aug 24 07:53:36.993261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': 'f3fc438f-93a3-42ad-afca-903bd782e62b'} Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:36.993968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. Aug 24 07:53:36.995280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:53:36.996528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] Returning 404 to user: Instance f3fc438f-93a3-42ad-afca-903bd782e62b could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:36.996528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0662ee59-540a-4f20-b592-0c943ded28a4 tempest-VolumesActionsTest-1379634553 tempest-VolumesActionsTest-1379634553-project] 10.222.0.26 "GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b" status: 404 len: 111 microversion: 2.1 time: 0.030862 Aug 24 07:53:36.996528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 127/261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:36 2022] GET /compute/v2.1/servers/f3fc438f-93a3-42ad-afca-903bd782e62b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:53:37.772611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:37.774884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:37.782181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:37.782597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:37.783550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:37.784440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:37.785111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:37.785715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:37.832855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'flavor' on Instance uuid 87322eac-6f5b-4382-afab-9c669bb6b2f3 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:53:38.152581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ec1c8708-0921-42e4-8a64-c80c539d4f85 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/action" status: 200 len: 32 microversion: 2.1 time: 0.384221 Aug 24 07:53:38.153461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 135/262] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:53:37 2022] POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:53:38.163057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:38.164457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:38.172105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:38.172586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:38.173038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:38.174405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:38.175086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:38.175502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:38.362969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:38.370847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fda72417-1831-4a3a-adcc-adba5601289e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.211635 Aug 24 07:53:38.371579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 128/263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:38 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:39.393418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:39.394123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:39.400542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.401085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.401519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.402213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.402661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.403091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.660077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:39.698935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a7c9aaba-5601-4ecf-8cae-d82d724d1f3b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.308812 Aug 24 07:53:39.701183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 136/264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:39 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:39.832267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:39.832267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:39.838609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.839110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.839500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.840228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.840687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.841098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.865440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ff19d794-871d-46e0-b74b-a3df54bbbc48 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/ips" status: 200 len: 151 microversion: 2.1 time: 0.038077 Aug 24 07:53:39.867530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 129/265] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:53:39 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:40.724769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:40.725394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:40.733679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:40.734158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:40.734580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:40.735464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:40.737302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:40.737882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:40.911862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:40.922948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f3eb82a9-b9db-471b-bb99-ca1fd28442ef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.204816 Aug 24 07:53:40.923672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 137/266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:40 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:41.944030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:41.944630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:41.952202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:41.952711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:41.953145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:41.959089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:41.959089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:41.959089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:42.149343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:42.157122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d2efdaaf-1244-4a65-9144-dc8961e8ffd7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.217624 Aug 24 07:53:42.158361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 130/267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:41 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:42.837957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9988780-f40a-4bfd-af08-b42a938053ae"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:42.841293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:42.850997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:42.851653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:42.852568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:42.853487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:42.854330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:42.855460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.184179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:43.184179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:43.192500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.193230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.194002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.196482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.197624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.198183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.942863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:43.948808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5ea9199c-0c01-4a6f-b816-6c494fe985f5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.115975 Aug 24 07:53:43.949602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 138/268] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:53:42 2022] POST /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:43.955352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f4e624b-d4c5-489d-b01e-2bfe85526573 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.779135 Aug 24 07:53:43.972123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 131/269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:43 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:44.995186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:44.995879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:45.014080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:45.018203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:45.019949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:45.021345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:45.023663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:45.024251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:45.098193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:45.269950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:45.292181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-77caa1ad-6639-4dff-bdea-78bf6814a21a tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.302705 Aug 24 07:53:45.292791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 139/270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:44 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:46.321210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:46.322407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:46.347375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:46.349330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:46.350072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:46.350780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:46.353071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:46.354167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:46.354841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:46.690816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:46.717967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1b047222-e8ea-4622-bae0-8a8ea786dfdc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.403857 Aug 24 07:53:46.719791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 132/271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:46 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:47.451324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:47.452544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:47.467826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.477419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.478105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:47.478854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.479312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.479736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:47.537700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-07ea9fcb-c476-4d9b-854c-953b0f9fc6e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/ips" status: 200 len: 146 microversion: 2.1 time: 0.090079 Aug 24 07:53:47.538480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 140/272] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:53:47 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/ips => generated 146 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:47.744015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:47.745328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:47.757828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.760104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.764191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:47.764958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.765416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.766582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:48.159137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:48.179227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e31c6298-951b-4936-b96e-d82a5743637e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.441059 Aug 24 07:53:48.208850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 133/273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:47 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:49.232146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:49.232926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:49.266546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:49.269922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:49.270870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:49.287358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:49.293368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:49.298727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:49.675442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:49.683732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-132c3aec-751d-4663-9e83-0f5867dba380 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.457911 Aug 24 07:53:49.694542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 141/274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:49 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:50.706826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:50.708170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:50.725068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:50.727054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:50.727606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:50.728444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:50.732771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:50.733331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:51.231931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84fb0259-77ee-47ad-b11d-b4a2ffc4d388"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:51.236108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:51.255923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:51.256446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:51.256908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:51.257614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:51.262528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:51.263214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:51.424128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:51.438202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d87e560f-c262-4981-a0e7-82b4360efe84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.732751 Aug 24 07:53:51.441648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 134/275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:50 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:52.461056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:52.461681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:52.472972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:52.473461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:52.473894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:52.488708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:52.493088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:52.495455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:52.618466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b47644c6-c46a-4ce5-9d7f-1fd41ddb08a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.391941 Aug 24 07:53:52.621605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 142/276] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:53:51 2022] POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments => generated 194 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:52.648555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b617526b-2a1e-498a-896c-be9503cf6a9c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: .version_select at 0x7f45682068b0>, body: {"keypair": {"name": "tempest-keypair-1926459457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgP1dXoLw01VW0omMCwugYU7G9DZNac6M9QZFMRwHzZsn93Fc3KZJ96mFkoiW/meBccodJYvSo1Sp6uKY/H1drV/nD6iW3QEW/5PMBJG6zVm624VcUYIbwf73cZEEzJdg=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:52.818539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b617526b-2a1e-498a-896c-be9503cf6a9c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:53:52.851589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b617526b-2a1e-498a-896c-be9503cf6a9c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:53:53.109466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b617526b-2a1e-498a-896c-be9503cf6a9c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483152 Aug 24 07:53:53.110297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 143/277] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:53:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:53.251726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:53.262035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-23998670-7a0c-4940-9c40-e055127c54ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.804921 Aug 24 07:53:53.263193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 135/278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:52 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:54.284891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:54.285809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:54.307650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:54.309402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:54.318479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:54.318479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:54.318479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:54.322422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:55.082219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:55.103848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d9ff9acd-6ffe-47d7-864f-4f7efcbb2f13 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.819585 Aug 24 07:53:55.113202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 144/279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:54 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:56.141953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:56.144424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:56.178794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.179749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.183759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.192957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.200458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.201964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.665351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:56.679599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-93d16649-35b2-49ec-aa18-7e9fcfe66568 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1502 microversion: 2.1 time: 0.544990 Aug 24 07:53:56.680194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 136/280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:56 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1502 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:56.700438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bc8ccec-0f1f-41e1-8b55-16cf035e7105"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:56.712838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:56.718580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.719065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.719493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.741006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.741680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.742127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.848403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] HTTP exception thrown: Cannot 'attach_volume' instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 while it is in vm_state rescued Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Request method failure captured: Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/os-volume_attachments HTTP/1.1 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 74 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdikBRAn27k9M6f2KCiv1ag_86tIj8pmXaeEkPajvJ6pZgX4fEXkW6EPiFc7s23Bi0290etk-9ELd2V9lkOYCUy-9uRgXS-9oJ9GUCcLUH9KUWo6dXnDNqfM0OTMxbn6kpJ6V2KMvwI7FqrKVxoJLGbG2gylyqpFChvTkXnJ7rQ3B34 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:53:56.887348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}] Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: e23edadcfe3d4a0b81b13e278682ca2f Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {"volumeAttachment": {"volumeId": "1bc8ccec-0f1f-41e1-8b55-16cf035e7105"}} Aug 24 07:53:56.888841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Cannot 'attach_volume' instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 while it is in vm_state rescued Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '87322eac-6f5b-4382-afab-9c669bb6b2f3', 'body': {'volumeAttachment': {'volumeId': '1bc8ccec-0f1f-41e1-8b55-16cf035e7105'}}} Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:53:56.889650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 while it is in vm_state rescued Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:53:56.890870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 while it is in vm_state rescued Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Returning 409 to user: Cannot 'attach_volume' instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 while it is in vm_state rescued {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ea78a843-7f53-49f1-97da-f5ef6c9b5e30 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.177882 Aug 24 07:53:56.893444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 145/281] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:53:56 2022] POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/os-volume_attachments => generated 152 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:53:56.893965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:56.894731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:56.908133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.910873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.911447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.915261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:56.917662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:56.918238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:57.404675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9152ab2c-264e-4b8a-ab6c-db9d9421c6d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/action" status: 202 len: 0 microversion: 2.1 time: 0.517295 Aug 24 07:53:57.404675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 137/282] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:53:56 2022] POST /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:53:57.416966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:57.417583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:57.428258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:57.429055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:57.429666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:57.435435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:57.436142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:57.436769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:57.976094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:58.006496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f17a3d08-5ed5-4a2d-b50a-b855a2837d5b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1510 microversion: 2.1 time: 0.587896 Aug 24 07:53:58.008184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 146/283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:57 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1510 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:58.421672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9ee140b2-971d-45cf-8a8a-029e6604a29e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Action: 'create', calling method: .version_select at 0x7f45683d5ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1393284113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtuAXdN7tYBi6jXqTAi6Hw9Fxjhb4pWwuSDhgHkj7oiUpKs/588ab5grCnOimnuRf2Xmz66jMOzVUbSk9IEr5f73HBZ9IiDY8aDX9WO+DfbnI0ch25trmWBLuhFvKUdeA=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:58.461399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-9ee140b2-971d-45cf-8a8a-029e6604a29e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Getting quotas for project 7d8b8ee42f4d499499f24e29d7a8249d. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:53:58.466323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-9ee140b2-971d-45cf-8a8a-029e6604a29e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Getting quotas for user 7f3a2203128f46528a40a9f55b54b5b9 and project 7d8b8ee42f4d499499f24e29d7a8249d. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:53:58.583984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9ee140b2-971d-45cf-8a8a-029e6604a29e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.689165 Aug 24 07:53:58.584628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 138/284] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:53:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:58.954633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1615526952", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25fc9eb1-bc13-4133-b4c8-3baba837afc7"}], "security_groups": [{"name": "tempest-securitygroup--1265669762"}], "key_name": "tempest-keypair-1926459457", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:53:59.031494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:59.032910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:59.047764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:59.048263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:59.048715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:59.057861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:59.065385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:59.065835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:59.315955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] validate_networks() for [('25fc9eb1-bc13-4133-b4c8-3baba837afc7', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:53:59.663392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:59.696176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1436bd6b-7766-4e1e-9637-1ca698eaef46 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1510 microversion: 2.1 time: 0.662781 Aug 24 07:53:59.700011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 139/285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:59 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1510 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:00.732114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:00.738852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:00.749366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:00.756534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:00.757186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:00.758846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:00.760503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:00.761440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:01.340109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:54:01.340109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:54:01.340109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:54:01.340109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:54:01.340109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:54:01.360898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:01.364171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:01.370420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:01.370420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:01.370420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:01.370420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:01.475965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:01.488736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:01.520588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:54:01.526890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:54:01.744625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-591ae0ae-d941-4cf2-90f5-e5976d582011 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.793134 Aug 24 07:54:01.746617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 147/286] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:53:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:54:01.759215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-583eb9a1-da20-46ea-abf0-cffb5e19dc12 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:01.760486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-583eb9a1-da20-46ea-abf0-cffb5e19dc12 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:01.824770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:01.837897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:01.842956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8f554b5e-9a49-4879-8915-3a19398ed252 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1510 microversion: 2.1 time: 1.115962 Aug 24 07:54:01.845363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 140/287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:00 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1510 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:01.928225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-583eb9a1-da20-46ea-abf0-cffb5e19dc12 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:01.936929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-583eb9a1-da20-46ea-abf0-cffb5e19dc12 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1242 microversion: 2.1 time: 0.183826 Aug 24 07:54:01.941073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 148/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:01 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:02.087841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:02.095464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.096382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.097063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.184109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Going to try to stop instance {{(pid=132893) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 07:54:02.394326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c28a3265-1d38-4b51-9316-53035d91b9ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action" status: 202 len: 0 microversion: 2.1 time: 0.310544 Aug 24 07:54:02.395466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 141/289] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:54:02 2022] POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:54:02.403805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:02.404639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:02.429051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.432182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.434726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.435524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.436413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.437788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.778493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:02.790500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b45b7c03-2d22-4627-aa67-022f969eaa30 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.390377 Aug 24 07:54:02.793600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 149/290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:02 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:02.868593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:02.869377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:02.883551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.884052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.884495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.885234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.885688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.886111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.961714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3d1683f2-1c57-40e6-acd6-1ff4156c9fcf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:02.962503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3d1683f2-1c57-40e6-acd6-1ff4156c9fcf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:03.148584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3d1683f2-1c57-40e6-acd6-1ff4156c9fcf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:03.156091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3d1683f2-1c57-40e6-acd6-1ff4156c9fcf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1242 microversion: 2.1 time: 0.198398 Aug 24 07:54:03.158192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 150/291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:02 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:03.477151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:03.502573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-05976d83-64b8-4290-84d1-429c6b902c14 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1510 microversion: 2.1 time: 0.624909 Aug 24 07:54:03.507412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 142/292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:02 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:03.815331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:03.815961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:03.835233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:03.835731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:03.846289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:03.849766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:03.851083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:03.851575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.180183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:04.180990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:04.191170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.199349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.200121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.201097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.201715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.202294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.395459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:04.413243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e9c07f7b-2ebb-40bc-85e1-520bdcb56924 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1238 microversion: 2.1 time: 0.236398 Aug 24 07:54:04.415878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 143/293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:04 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1238 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:04.481735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:04.499092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-33734068-bd5c-43f7-afaf-8f32ccf88516 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.687327 Aug 24 07:54:04.510567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 151/294] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:03 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:04.532744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:04.534980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:04.556864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.568933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.569637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.574349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.577020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.578680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:05.114049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:05.135746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8bb32767-2ffe-42ff-bdb1-bb53d7420edc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1516 microversion: 2.1 time: 0.610530 Aug 24 07:54:05.136827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 144/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:04 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1516 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:05.438416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:05.439902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:05.446790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:05.458626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:05.459111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:05.459547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:05.466708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:05.467195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:05.468494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:05.523769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:05.524799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:05.542574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:05.545463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:05.549603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:05.549603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:05.551743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:05.552450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:06.014403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:06.020913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:06.029532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ce3b0270-fa10-4dd5-9790-a0c6a2ef12f0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.509776 Aug 24 07:54:06.031304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:05 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:06.048459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8681aaee-885a-49cc-a1fd-f943405fa777 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1302 microversion: 2.1 time: 0.611365 Aug 24 07:54:06.050127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 152/297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:05 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1302 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:07.053288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:07.053948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:07.076805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:07.082146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:07.099056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.099556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.099994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.100725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.101176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.101595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.106715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.107282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.107715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.108417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.108883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.109301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.404697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:07.424631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb026dd3-7004-4329-ae3a-78f263ff0cfd tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1300 microversion: 2.1 time: 0.353725 Aug 24 07:54:07.428380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:07 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1300 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:07.457691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cd01cd59-ffce-4a1b-a5cb-cfbe231c64f9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: .version_select at 0x7f45680aca60>, body: {"keypair": {"name": "tempest-keypair-2074935891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlWfby327Rl9/lbflIFwCwiWCzL2BczvDY7U8v/4A1ey4MT3pJYeyd/L4+SsIa3FnHT01AMLlH/zy2g1BlBZu4qfNLZJ+6X9jRt2jqqLeu6ZB0Vbadp74fq3PfG/LvE0g=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:07.503827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-cd01cd59-ffce-4a1b-a5cb-cfbe231c64f9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for project a75ba813beae4999b9ae2afd58de8d25. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:07.510115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-cd01cd59-ffce-4a1b-a5cb-cfbe231c64f9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for user e23edadcfe3d4a0b81b13e278682ca2f and project a75ba813beae4999b9ae2afd58de8d25. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:07.517115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:07.528911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e52f00c9-80bc-4db0-af42-05ce5a06bd5d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.481422 Aug 24 07:54:07.531466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 146/299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:07 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:07.643496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cd01cd59-ffce-4a1b-a5cb-cfbe231c64f9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198927 Aug 24 07:54:07.645673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 154/300] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:54:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:08.450871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:08.452079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:08.468893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.470291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.472308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.473463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.475350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.476145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.477930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=4 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.558560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:08.559164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:08.570687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.573749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.574225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.575131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.575767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.576337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.902906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:08.924525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-acdc0271-fd2c-4a7d-bb3a-e6e487633537 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.369659 Aug 24 07:54:08.936823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 155/301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:08 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:09.382882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-645dc440-0333-4320-88af-43bc85dbf3cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Action: 'create', calling method: .version_select at 0x7f4569329b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1569750893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4aO5P7mUVz8Pl9X1wyKfGIv1kAmhDoCQnqMVkOA/mOGektnRQcHykroZdjElVnsg3kH8ZqODLoH9QtRYY3OvFmrQB4c8KdpduhvhT+V3qn31a6LFKlqcI80VSsoS6Exw=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:09.408476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:09.416516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-645dc440-0333-4320-88af-43bc85dbf3cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Getting quotas for project 65b31c186fea438d9d17af25036099e4. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:09.424103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a80e0721-5419-4990-8fb4-aaa0e23cc8d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.978111 Aug 24 07:54:09.425418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 147/302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:08 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:09.428583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-645dc440-0333-4320-88af-43bc85dbf3cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Getting quotas for user 9a4f3bfb16c6418cbdc1b6e8d4457a9a and project 65b31c186fea438d9d17af25036099e4. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:09.591946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-645dc440-0333-4320-88af-43bc85dbf3cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.639024 Aug 24 07:54:09.600593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 156/303] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:54:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:09.952069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:09.952765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:09.966040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:09.968218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:09.968935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:09.972869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:09.973820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:09.979058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.130012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16139508-8460-4a57-897f-5bcd03173a4a", "tag": "fb57dc93-e31e-4602-9e4c-07e407805e15"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:10.150264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:10.151162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:10.152034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.185704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] Creating event network-changed:fb57dc93-e31e-4602-9e4c-07e407805e15 for instance 16139508-8460-4a57-897f-5bcd03173a4a on hv-cinder-85427 Aug 24 07:54:10.203175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-bad5757b-fbbc-4e24-9bbb-a51fa9fc9773 req-c1452af6-4d76-4e9c-9487-826deb4d2e7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071908 Aug 24 07:54:10.203175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 157/304] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:10.453925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:10.454988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:10.462353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:10.464230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:10.464866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.465761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:10.468533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:10.469264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.539482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:10.567943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-edf936a2-37e1-40ec-a08d-c54f196af12b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.620378 Aug 24 07:54:10.571628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 148/305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:09 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:10.819027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:10.831328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c85b4b9-d86f-4afc-a4a1-6c7bb8d934ab tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.388902 Aug 24 07:54:10.832752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 158/306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:10 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:11.607523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:11.619137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:11.645785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.646290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.649236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:11.651556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.654840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.658818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:11.857151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:11.859280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:11.863791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:11.869270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.869941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.870590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:11.871679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.874391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.875011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:12.175357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:12.184391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bdb335ec-84e0-4f34-9403-d810f858999a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.597316 Aug 24 07:54:12.185013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 149/307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:11 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:12.562382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:12.574802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9b278ae1-6e68-4fb5-a7fd-1bcfe5f8adf8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.720841 Aug 24 07:54:12.576694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 159/308] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:11 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:13.213294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:13.214020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:13.220949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.221349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.222401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.222531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.225174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.225174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.462534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:13.486197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3e319546-2631-4558-8f1b-7e8e91ad4a80 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.276583 Aug 24 07:54:13.486801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 150/309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:13 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:13.603026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:13.603929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:13.617139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.617934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.618529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.620236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.621891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.622220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.757359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-15452094", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6467c351-02a7-4a77-bea9-8d9b5e17596b"}], "security_groups": [{"name": "tempest-securitygroup--23741322"}], "key_name": "tempest-keypair-2074935891", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:13.801574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:13.811548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-355ee83d-8888-421c-98df-784393ad966b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.212819 Aug 24 07:54:13.812668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 160/310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:13 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:14.508948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:14.509572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:14.522584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.523234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.524114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:14.524962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.525658 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.526329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:14.689374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:14.694104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:14.701038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7d7bbd4e-c0d4-46bc-8dd8-8bd0511397dd tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.197170 Aug 24 07:54:14.712819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 161/311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:14 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:14.835059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:14.835924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:14.844317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.845728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.846402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:14.847513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.848242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.849121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:15.021543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:15.029998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dfcf9d5d-d9a3-4087-9be8-fccdda485b0f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.199250 Aug 24 07:54:15.030601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 162/312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:14 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:15.724520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:15.725353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:15.733448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:15.734150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:15.735288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:15.736172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:15.737274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:15.737274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:15.891243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:15.901640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fcf31477-9713-40d5-b088-cbafe59a146d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.180991 Aug 24 07:54:15.902243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 163/313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:15 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:16.051935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:16.058096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:16.062091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.062587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.063239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:16.063990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.064435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.065062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:16.219610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:16.228504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0b4bbbb5-45c4-4b8e-8e1d-ddd9672b4e4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.181314 Aug 24 07:54:16.229181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 164/314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:16 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:16.923706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:16.924407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:16.931818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.932570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.933221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:16.934733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.935348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.935983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:17.096845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:17.107096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e71a2981-2637-4829-a9e2-dfce48f9bed0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.187323 Aug 24 07:54:17.109794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 165/315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:16 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:17.252286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:17.253046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:17.259998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:17.260571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:17.261215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:17.261943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:17.262394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:17.262815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:17.452145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:17.461248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9068dbd4-49ff-460f-9936-bad7606b5354 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.213634 Aug 24 07:54:17.467912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 166/316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:17 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:18.131507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:18.132205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:18.138870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.139347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.139777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.140466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.140980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.141402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.312386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:18.322639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5852424c-108e-4973-8152-090a519a8923 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.195917 Aug 24 07:54:18.323341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 167/317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:18 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:18.485961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:18.487090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:18.494824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.495308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.495742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.496919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.497562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.498111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.651548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:18.659159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f8da40a3-7d97-43ae-b11d-f9b3d2cc72d8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.180591 Aug 24 07:54:18.659746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 168/318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:18 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:19.343998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:19.344585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:19.352325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.352831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.353263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.354020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.354613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.355022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.442827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=22 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:19.485622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] validate_networks() for [('6467c351-02a7-4a77-bea9-8d9b5e17596b', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:54:19.509985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:19.520034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-408007a0-4e57-4101-a21e-eb7c35ebf828 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.179823 Aug 24 07:54:19.520962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 169/319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:19 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:19.684098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:19.684098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:19.686727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.687225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.687707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.688390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.690414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.690841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.832524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:19.841408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ad0c06e3-3117-452a-a525-11cbee00139a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.165245 Aug 24 07:54:19.842263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 170/320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:19 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:19.902713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:54:19.903129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:54:19.903592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:54:19.904023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:54:19.904423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:54:19.913952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.914422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.914854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.915564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.916005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.916416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.934418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:19.938401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Getting quotas for user e23edadcfe3d4a0b81b13e278682ca2f and project a75ba813beae4999b9ae2afd58de8d25. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:19.949390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:54:19.951777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:54:20.070073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7413bb03-1eb5-4aa1-8c9e-8757470a954d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 6.331092 Aug 24 07:54:20.070704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 151/321] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:54:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 6332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:54:20.081818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae37ae2d-5ab1-4553-8456-0c1d112874a9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:20.082427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae37ae2d-5ab1-4553-8456-0c1d112874a9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:20.140390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae37ae2d-5ab1-4553-8456-0c1d112874a9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:20.149342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae37ae2d-5ab1-4553-8456-0c1d112874a9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1244 microversion: 2.1 time: 0.071588 Aug 24 07:54:20.149911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 171/322] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:20 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:20.542133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:20.542852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:20.549921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.551248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.551742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:20.552745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.553275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.553764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:20.715323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:20.724119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3bc1422f-1cc8-4f1a-bb67-3ae48c64205c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.185811 Aug 24 07:54:20.724676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 152/323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:20 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:20.863134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:20.863786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:20.871318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.871798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.872259 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:20.872987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.873467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.873882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.013829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:21.022301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-12734de8-286c-482c-ac87-29264ae9f346 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.163083 Aug 24 07:54:21.022889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 172/324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:20 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:21.170638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:21.178357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:21.178357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.178357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.178737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.182993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.182993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.182993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.243510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:21.252701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9c7840be-1625-4b2e-8c37-e673fd4247a7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1248 microversion: 2.1 time: 0.086080 Aug 24 07:54:21.253665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 153/325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:21 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:21.745457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:21.746156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:21.752843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.753236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.753665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.754351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.754838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.755268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.899291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:21.908043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c2d8fc4a-d2d7-4449-b335-2d7dc62eed6e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1724 microversion: 2.1 time: 0.166379 Aug 24 07:54:21.909003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 173/326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:21 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:22.042522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:22.043243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:22.045415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:22.051472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.052077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.056934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.056934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.056934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.056934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.193732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:22.205798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6876b8d-69c6-493c-a87b-a8e2d39c59f0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.167351 Aug 24 07:54:22.206591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 154/327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:22 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:22.273997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:22.274511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:22.280470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.281013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.281436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.282111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.282553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.283536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.356915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:22.377259 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0e641497-3163-4e37-b8df-e93ee381dd4b tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1296 microversion: 2.1 time: 0.107122 Aug 24 07:54:22.377815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 174/328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:22 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:22.793762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16139508-8460-4a57-897f-5bcd03173a4a", "name": "network-vif-plugged", "status": "completed", "tag": "fb57dc93-e31e-4602-9e4c-07e407805e15"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:22.811270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.812233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.812909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.825887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] Creating event network-vif-plugged:fb57dc93-e31e-4602-9e4c-07e407805e15 for instance 16139508-8460-4a57-897f-5bcd03173a4a on hv-cinder-85427 Aug 24 07:54:22.831484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-2eaf6f8e-3523-4fb0-a430-409f05424209 req-e1d733a8-47b9-42b9-a058-c88cb4200a9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041776 Aug 24 07:54:22.832317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 155/329] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:22.931417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:22.932012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:22.939163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.940204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.940749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.941584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.942127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.942645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.091730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:23.103238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-733bf608-d9d6-4cc5-b9cf-31bfc8226baf tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1701 microversion: 2.1 time: 0.175788 Aug 24 07:54:23.103900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 175/330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:22 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1701 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:23.125233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:23.132819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.133345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.137320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.157323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Going to try to start instance {{(pid=132893) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 07:54:23.238092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:23.238797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:23.245104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.245596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.246014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.246965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.247408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.247820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.254871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:23.349189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b28edbf6-dbd6-47aa-82b1-21ff629e7105 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action" status: 202 len: 0 microversion: 2.1 time: 0.228075 Aug 24 07:54:23.353583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 156/331] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:54:23 2022] POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:54:23.358914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:23.359599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:23.377540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.378409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.386357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.386357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.386357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.386357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.515554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:23.525727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0401ca23-9b83-4e65-a9e7-083d7072492e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.291884 Aug 24 07:54:23.569467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 176/332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:23 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:23.590931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:23.591546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:23.599030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.599726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.600350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.601233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:23.601827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:23.602396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:23.771762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:23.781988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c3e57271-14a7-41ef-9e24-e73ed50f573d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.209788 Aug 24 07:54:23.783857 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 177/333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:23 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:23.839702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:23.849159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e9aefea-ede0-4763-a9c4-7a91b1b15171 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.494452 Aug 24 07:54:23.850045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 157/334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:23 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:24.555841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:24.556448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:24.563230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.563685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.564124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.564878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.565361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.568823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.774695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:24.792217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f20c8b6f-a996-422b-841c-8548767b6649 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1368 microversion: 2.1 time: 0.232099 Aug 24 07:54:24.792217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 178/335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:24 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:24.806745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:24.810999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:24.818147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.818857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.819459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.820312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.820967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.821537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.872164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:24.873014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:24.880727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.881573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.882210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.888394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.889042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.889655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.913622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:25.049053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:25.057021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6a1a422d-031b-4d77-a667-8f4c583ec8f2 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.254219 Aug 24 07:54:25.057586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 158/336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:24 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:25.082792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:25.092954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-11f3f609-3b5f-442c-a7df-513fcd58e567 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.225951 Aug 24 07:54:25.093665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 179/337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:24 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:25.144185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:25.154927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:25.155558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:25.156251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:25.172456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] Creating event network-changed:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:54:25.179402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-3f06db88-17f8-4c5a-9cb3-5c141d1fa5ee req-5444f867-95c0-41d3-9a3a-25c7986d9294 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039567 Aug 24 07:54:25.182015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 159/338] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:25.805085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:25.805735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:25.812545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:25.813096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:25.822635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:25.822635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:25.822635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:25.822635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:25.974686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:25.983639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b08c6c87-955d-4db3-bdfb-beb4d500d619 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1559 microversion: 2.1 time: 0.182289 Aug 24 07:54:25.997433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 180/339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:25 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:26.011146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:26.012400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:26.021467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.021996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.022542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.023240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.023679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.024090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.077223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:26.078815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:26.087446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.088001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.088526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.089415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.089937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.090630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.118478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-57ca0c1a-142c-4e20-8a83-d3b7317c224a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116089 Aug 24 07:54:26.120282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 160/340] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:54:26 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:26.124375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:26.125223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:26.133050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.133531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.133998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.134681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.135118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.135527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.361141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:26.370381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49445407-6f77-4c4f-b2cc-fc61767909f7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.250066 Aug 24 07:54:26.370954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 161/341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:26 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:26.420718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:26.428801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e6de29f6-514b-4ab9-8fb9-0d90a6175f51 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.355354 Aug 24 07:54:26.429371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 181/342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:26 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:27.391412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:27.392072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:27.398855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.399328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.399754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.400451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.400940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.401525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.414970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16139508-8460-4a57-897f-5bcd03173a4a", "tag": "fb57dc93-e31e-4602-9e4c-07e407805e15"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:27.426437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.426924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.427351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.439735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] Creating event network-changed:fb57dc93-e31e-4602-9e4c-07e407805e15 for instance 16139508-8460-4a57-897f-5bcd03173a4a on hv-cinder-85427 Aug 24 07:54:27.446111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c5306581-3871-4eb3-8e08-d345755dafb7 req-8150d488-1a37-4575-aed4-0e66e2f186e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034742 Aug 24 07:54:27.446717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 182/343] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:27.456003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:27.456939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:27.463903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.464237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.464747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.465501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.466132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.466892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.566795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:27.576594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-791dea6a-fe8c-423f-b1ed-7ab2e8c7cbe8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.188891 Aug 24 07:54:27.577193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 162/344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:27 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:27.618947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:27.627355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a314787e-03b1-4f4c-a13e-b9411bea0af5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.175897 Aug 24 07:54:27.628066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 183/345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:27 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:28.599551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:28.600177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:28.606497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.607048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.607511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.608248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.608780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.609201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.647789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:28.648405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:28.655764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.656303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.656705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.657409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.658512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.658940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.758522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:28.768192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-79b3834b-90dd-4ba1-bcdf-c66d4312641c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.172719 Aug 24 07:54:28.772715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 163/346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:28 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:28.805078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:28.809792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8a91a58-06aa-4b89-94a3-3bc33d88a8fa tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.165829 Aug 24 07:54:28.815994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 184/347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:28 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:29.790023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:29.790577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:29.796550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.798858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.798858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.798858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.799335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.799624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.835110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:29.836233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:29.849163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.854363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.854363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.854363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.854363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.856555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.926285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:29.945548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:30.079059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:30.097598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe945d45-7e7c-4709-8414-865ee30265d1 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1710 microversion: 2.1 time: 0.311497 Aug 24 07:54:30.098190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 164/348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:29 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1710 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:30.129614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:30.143104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-89b85625-bfb5-4c08-b715-bbec58c55966 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.312116 Aug 24 07:54:30.146506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 185/349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:29 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:31.122768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:31.126816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:31.130282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.130757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.131185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.131873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.132315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.132806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.164621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:31.165192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:31.167127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:31.172792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.175469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.175469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.175469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.175469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.175867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.274830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:31.283794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd0f09f6-d226-484e-be7d-7f68cccf6c87 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1714 microversion: 2.1 time: 0.165030 Aug 24 07:54:31.284374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 165/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:31 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:31.316681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:31.324458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b569033-9406-4b27-9752-10d5b4331ede tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.163802 Aug 24 07:54:31.325043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 186/351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:31 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:32.345911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:32.347333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:32.353429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:32.353901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:32.354322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:32.355004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:32.355444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:32.355896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:32.497309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:32.509418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e1844363-0d93-410a-ab24-933b4aabf77c tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.163615 Aug 24 07:54:32.509418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 166/352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:32 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:33.527773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:33.529986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:33.537561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:33.540047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:33.540047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:33.540047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:33.540047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:33.540435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:33.682957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:33.691697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab97c1fd-75a1-4af5-97ca-81b56ac6fa89 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.167444 Aug 24 07:54:33.692673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 187/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:33 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:34.714120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:34.714800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:34.720689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:34.721166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:34.721641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:34.722513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:34.723693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:34.723693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:34.855520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:34.863426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-23d9d8d9-fe3a-434a-99c9-30f7d76f75dc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.152997 Aug 24 07:54:34.863991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 167/354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:34 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:35.883810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:35.884399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:35.886854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:35.891531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:35.892037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:35.892474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:35.893187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:35.893634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:35.894578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:36.030229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:36.038835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fdf4c139-26bc-480f-b8dc-53ab47eb05cd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.158986 Aug 24 07:54:36.039448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 188/355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:35 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:36.681657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2130690129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1393284113", "security_groups": [{"name": "tempest-secgroup-smoke-1620892526"}], "networks": [{"uuid": "bf85ae6a-bbe6-4a07-a10a-c10089917c3a"}], "block_device_mapping_v2": [{"uuid": "9ba08db2-94d5-4ce2-a126-058a4692ed28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:36.699353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "name": "network-vif-plugged", "status": "completed", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:36.711858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:36.712340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:36.712797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:36.724316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] Creating event network-vif-plugged:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:54:36.729706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-9ace91cb-68d7-4a12-bd69-52d046811e09 req-e86480ca-534d-4ac9-81c2-a5f99fe94cca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036839 Aug 24 07:54:36.736961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 189/356] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:36.813653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] validate_networks() for [('bf85ae6a-bbe6-4a07-a10a-c10089917c3a', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:54:37.060441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:37.061307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:37.068312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.068742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.069166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.069843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.070285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.070922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.257326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:37.272058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5787af1a-c068-4a19-98ac-a08b8e4e79b3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.211554 Aug 24 07:54:37.272058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 190/357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:37 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:37.320048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:54:37.320411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:54:37.320901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:54:37.321689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:54:37.322094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:54:37.333524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.334002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.334425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.335136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.335578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.335993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.364941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Getting quotas for project 7d8b8ee42f4d499499f24e29d7a8249d. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:37.366843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Getting quotas for user 7f3a2203128f46528a40a9f55b54b5b9 and project 7d8b8ee42f4d499499f24e29d7a8249d. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:37.442293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:54:37.445028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ba08db2-94d5-4ce2-a126-058a4692ed28',volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:54:37.941547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4463ecd6-3a8c-4605-8748-8a070143410f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.265411 Aug 24 07:54:37.942515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 168/358] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:54:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:54:37.953754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac98b1e2-7dde-447b-943f-0b268754793c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:37.954388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac98b1e2-7dde-447b-943f-0b268754793c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:38.015920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac98b1e2-7dde-447b-943f-0b268754793c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:38.028724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac98b1e2-7dde-447b-943f-0b268754793c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1089 microversion: 2.1 time: 0.076943 Aug 24 07:54:38.029811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 191/359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:38.303858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:38.305994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:38.313392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:38.317148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:38.317148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:38.317148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:38.317148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:38.317687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:38.455089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:38.463551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25c9c7a2-23b6-47c4-872d-008d392c61e0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1368 microversion: 2.1 time: 0.173207 Aug 24 07:54:38.464118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 169/360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:38 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:39.050967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a6be6785-fb59-40e8-855d-98ec4a14b189 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:39.051692 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a6be6785-fb59-40e8-855d-98ec4a14b189 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:39.110197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a6be6785-fb59-40e8-855d-98ec4a14b189 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:39.118350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a6be6785-fb59-40e8-855d-98ec4a14b189 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1089 microversion: 2.1 time: 0.072206 Aug 24 07:54:39.118897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 192/361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:39.486461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:39.487378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:39.494748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.495312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.495750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.496431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.496940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.497354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.637154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:39.645547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e9b5b18-3b44-4f4e-a803-a1925af4a7c5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1562 microversion: 2.1 time: 0.165992 Aug 24 07:54:39.646115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 170/362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:39 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:39.666354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:39.666885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:39.672973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.673563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.673996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.674682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.675574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.675992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.772683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-07202993-6776-4ca9-b7a4-4b84b774212f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110111 Aug 24 07:54:39.773305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 193/363] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:54:39 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:40.146030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:40.146030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:40.154427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:40.155216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:40.155837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:40.161203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:40.162103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:40.162681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:40.341393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:40.355381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-09e2a60b-24c6-43bf-afad-8e77ec43ff0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1187 microversion: 2.1 time: 0.219780 Aug 24 07:54:40.356712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 171/364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1187 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:41.378712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:41.379517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:41.385639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:41.386129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:41.386553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:41.387411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:41.388004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:41.388758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:41.459330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:41.467931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f14509b-39dc-445a-bc8f-6bfc3d2fc86a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1205 microversion: 2.1 time: 0.094244 Aug 24 07:54:41.468510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 194/365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:41.766842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:41.778755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:41.779515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:41.780147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:41.797959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] Creating event network-changed:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:54:41.804095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-055bae88-dc87-4328-8404-a9abf7424d48 req-9976c052-7e37-4bd5-86fe-ae7d36b51530 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040850 Aug 24 07:54:41.804981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 172/366] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:42.492059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:42.493178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:42.520820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:42.525792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:42.528255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:42.539568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:42.540272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:42.541925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:42.732967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:42.746425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4fd99cf2-40e2-4526-bd60-4c06dcdd90ec tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1273 microversion: 2.1 time: 0.259578 Aug 24 07:54:42.757848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 195/367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:43.771257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:43.771940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:43.780166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:43.781589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:43.782217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:43.783148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:43.785069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:43.786063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:43.830829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:43.841262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:43.842378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:43.842378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:43.854809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] Creating event network-changed:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 07:54:43.859615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-209f4d7f-f7a1-4bc7-aa71-675bdb118447 req-ca804507-3837-4012-9bb1-8af96d67a4e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033290 Aug 24 07:54:43.860359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 196/368] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:44.012290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:44.021082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9e1232ba-2053-4eaa-a323-266c6cffd173 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.256464 Aug 24 07:54:44.021725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 173/369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:45.045065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:45.046387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:45.053591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:45.054077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:45.054510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:45.055198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:45.055646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:45.056063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:45.195091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:45.207610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5907bcfa-6f3a-4f42-b606-600925209722 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.167539 Aug 24 07:54:45.208264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 197/370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:46.227693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:46.228310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:46.234293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.234789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.235664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.235918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.236363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.236921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.370703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:46.379064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb2f4dc8-2257-4640-9c1d-d2f6d19124a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.154684 Aug 24 07:54:46.379615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 174/371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:47.400475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:47.401759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:47.408340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:47.409068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:47.410207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:47.410906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:47.411353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:47.411771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:47.556209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:47.564515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c03af03e-f085-499a-96ae-f331bfa3acbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.167824 Aug 24 07:54:47.565151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 198/372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:48.224732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-492451742", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1569750893", "security_groups": [{"name": "tempest-secgroup-smoke-2035946504"}], "block_device_mapping_v2": [{"uuid": "92f0afdf-d5ea-4108-b60e-d416291e5b52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a631f505-1595-46ac-a128-edfec6dd09c7"}]}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:48.234088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:48.234767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:48.338287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] validate_networks() for [('a631f505-1595-46ac-a128-edfec6dd09c7', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:54:48.586291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:48.586989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:48.599276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.599771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.600207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:48.600943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.601400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.601881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:48.707971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:54:48.708449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:54:48.708879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:54:48.709434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:54:48.709842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:54:48.719596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.720073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.720507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:48.721274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.721887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.722305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:48.735992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:48.739880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Getting quotas for project 65b31c186fea438d9d17af25036099e4. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:54:48.744115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Getting quotas for user 9a4f3bfb16c6418cbdc1b6e8d4457a9a and project 65b31c186fea438d9d17af25036099e4. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:54:48.744414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d4bba072-4a05-4e87-98dc-974ca238c115 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.162111 Aug 24 07:54:48.745087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 199/373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:48.802718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:54:48.804896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92f0afdf-d5ea-4108-b60e-d416291e5b52',volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:54:49.264471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2aae453e-f47a-452f-9b3a-c5b2c5c74f52 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043530 Aug 24 07:54:49.265086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 175/374] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:54:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:54:49.276545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-72b3fe66-b3f8-4d52-8d12-a290e95fd0c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:49.277185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72b3fe66-b3f8-4d52-8d12-a290e95fd0c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:49.279109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:49.335855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-72b3fe66-b3f8-4d52-8d12-a290e95fd0c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:49.343075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-72b3fe66-b3f8-4d52-8d12-a290e95fd0c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1094 microversion: 2.1 time: 0.070315 Aug 24 07:54:49.343803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 200/375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:49.765878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:49.766475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:49.773351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:49.773846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:49.774268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:49.774941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:49.775378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:49.775769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:49.791314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:49.914980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:49.923087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b1756535-e119-4930-abc4-5a9b840f0ecc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.161099 Aug 24 07:54:49.923652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 176/376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:50.363726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:50.364721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:50.371232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.371657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.372089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:50.372798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.373251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.373670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:50.392656 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:50.437965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:50.446552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac6d32ba-27e2-4e77-bcba-0f90e435d338 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1144 microversion: 2.1 time: 0.086754 Aug 24 07:54:50.447105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 201/377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:50.945736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:50.946336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:50.953026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.953500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.953933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:50.954609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.955054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.955466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:51.087364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:51.095367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3dd2a721-23fe-48c3-a46e-c96e86bea0ef tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.154058 Aug 24 07:54:51.095935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 177/378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:51.468356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:51.469005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:51.476431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:51.476932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:51.477365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:51.479169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:51.479169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:51.479169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:51.540465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:51.548196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8d8e59a-1925-4e12-b39a-1a66f7d4620e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1192 microversion: 2.1 time: 0.083710 Aug 24 07:54:51.548782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 202/379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:52.116029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:52.116903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:52.122993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.123471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.123939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.124671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.125128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.125551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.567822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:52.570035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:52.570661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:52.576324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-465e8f6e-52df-4daf-ba5e-5ae7d8849ae7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.464654 Aug 24 07:54:52.576940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 178/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:52.588851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.588851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.588851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.588851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.589231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.589231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.645397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:52.653356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4336a9c2-e717-42a3-954e-1f79bccf55e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1210 microversion: 2.1 time: 0.087878 Aug 24 07:54:52.654023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 203/381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:53.600318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:53.601582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:53.603430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:53.608250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.608911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.609396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.610076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.610692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.611108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.679191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:53.679800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:53.686470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.687023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.687551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.688300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.688882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.689362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.825849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:53.835044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-930734ed-e7f8-488c-bd4c-6ad12aa084df tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.238689 Aug 24 07:54:53.835501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:53.835679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 179/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:53.844229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14b6ef44-1632-4e74-9c65-1d0ed8f86fb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1278 microversion: 2.1 time: 0.169236 Aug 24 07:54:53.845029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 204/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:54.317232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996f4b36-7aa5-49d2-b619-ef9af95054de", "tag": "a33cc678-e925-41ba-b5d0-1c627df702a4"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:54.329584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.336372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.336372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.344275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] Creating event network-changed:a33cc678-e925-41ba-b5d0-1c627df702a4 for instance 996f4b36-7aa5-49d2-b619-ef9af95054de on hv-cinder-85427 Aug 24 07:54:54.351088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-b2d2327f-22ca-4eee-834d-248b47c8b019 req-c085a419-0c09-4db3-b912-a539e320052a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037870 Aug 24 07:54:54.351689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 180/384] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:54:54.766460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "name": "network-vif-plugged", "status": "completed", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:54:54.777133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.777760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.778188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.790048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] Creating event network-vif-plugged:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 07:54:54.795360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-36dffbf8-ab60-419a-baf6-9de16b7ffc84 req-65881043-4dce-4152-a9c0-80442a5b5d86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Aug 24 07:54:54.796244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 205/385] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:54:54.866803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:54.867503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:54.869269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:54.869959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:54.875257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.876196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.876831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.877407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.877594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.878052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.878177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.878473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.878574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.879296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.880281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.880736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:55.037101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:55.047322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:55.059581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f1816b91-f4c6-4134-a1df-ca1791a3f73b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.195771 Aug 24 07:54:55.060164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 206/386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:55.061799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bee19ff7-15de-4ce6-a2c3-573013b4d1e3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.199516 Aug 24 07:54:55.062854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 181/387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:56.080721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:56.081325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:56.088090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.088562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.089028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.089703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.090143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.090553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.091532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:56.092143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:56.098504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.099046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.106241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.106241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.106241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.106241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.223940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:56.232089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-75307577-9053-4e31-913d-b5afe4444143 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.155461 Aug 24 07:54:56.232676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 207/388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:56.239267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:56.247071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0ef4fc61-a755-49ce-bf6f-d562c65e2297 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.159275 Aug 24 07:54:56.247625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 182/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:57.251824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:57.252349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:57.258925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.259403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.259826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.260500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.260966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.261382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.267054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:57.267653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:57.273590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.274093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.274524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.275195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.275638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.276055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.400344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:57.408085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d04278d-d261-465e-81bf-fe28e5d00c2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.160269 Aug 24 07:54:57.408582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 208/390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:57.411373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:57.419100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d87a782d-e80b-4e44-89e0-e38960d5488f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.155819 Aug 24 07:54:57.419663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 183/391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:58.429634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:58.430265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:58.436670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:58.437151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:58.437583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:58.438260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:58.438697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:58.439108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:58.439930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:58.440565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:58.447673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:58.448255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:58.448702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:58.449424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:58.449932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:58.450377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:58.589128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:58.594837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:58.603405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c1db524b-b9c3-4b34-9ae1-1cb13eafa2b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.178372 Aug 24 07:54:58.603810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-601a810c-8608-46fe-be7c-fb2374fc777c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.167729 Aug 24 07:54:58.603989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 209/392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:58.604373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 184/393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:59.625038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:59.625709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:59.626102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:59.626192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:59.627503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:59.628145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:59.633080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.633569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.634008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.634713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.635165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.635583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.644175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.644971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.645470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.646394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.646909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.647405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.777505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:59.787320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac07c52f-f86a-4c6d-ab34-8e11c45c0069 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1261 microversion: 2.1 time: 0.166204 Aug 24 07:54:59.788274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 210/394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:59.797517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:59.805441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e47615aa-815f-4523-acb7-39dbe959dad2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.184180 Aug 24 07:54:59.806012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 185/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:00.808410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:00.809065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:00.811065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:00.816154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.819155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.819155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.819155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.819155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.819536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.833076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:00.833685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:00.839493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.839964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.840493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.841115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.841579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.841971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.952190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:00.960242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e30ce40d-f27d-4559-9fa2-4f3bd3d7e5c8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1444 microversion: 2.1 time: 0.155768 Aug 24 07:55:00.962427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 211/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:00.974802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:00.981509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:00.982192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:00.983009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c7fb548c-c4ac-4d63-8dd7-4859f77d598f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.153997 Aug 24 07:55:00.983583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 186/397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:00.988253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.989526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.992744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.992744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.992744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.992744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:01.131080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:01.139098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d9be19c-4de7-4087-9d37-d6ed0f4d70e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1444 microversion: 2.1 time: 0.161205 Aug 24 07:55:01.141575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 212/398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:02.005204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:02.005843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:02.012040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:02.012525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:02.012990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:02.013686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:02.014175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:02.014598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:02.154107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:02.162037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d61e5b16-066c-4da4-903c-9ab8e7132284 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.161053 Aug 24 07:55:02.162617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 187/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:03.182667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:03.183391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:03.189854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:03.195111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:03.195111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:03.195111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:03.195111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:03.195488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:03.394047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:03.402824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f72427d-eb6c-4ab4-8b75-3630a7d0a3a2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.224032 Aug 24 07:55:03.412766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 213/400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:03.502723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:03.513327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:03.513890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:03.514377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:03.526797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] Creating event network-changed:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 07:55:03.532078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-6eb7acd3-af01-4ce9-93e5-9c6195a98dda req-74119cf3-7372-4f0d-8a52-f37df908a6f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032886 Aug 24 07:55:03.532788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 188/401] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:04.428428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:04.428428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:04.431479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:04.431904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:04.432330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:04.433064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:04.433485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:04.433894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:04.570930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:04.579183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b5f81e7b-2c0b-4fb5-b3a7-ebb66a20d51c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.159587 Aug 24 07:55:04.579748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 214/402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:05.602246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:05.602957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:05.609236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:05.609703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:05.610124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:05.610788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:05.611226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:05.611634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:05.751236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:05.759446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2f25864b-5e8f-4a4a-8407-193472a63ddb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.161893 Aug 24 07:55:05.760052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 189/403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:06.781031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:06.781648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:06.788416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:06.788933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:06.789370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:06.790058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:06.790575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:06.790996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:06.932862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:06.942057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25d438ea-f3be-45fa-897e-222f5fa79897 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.164768 Aug 24 07:55:06.942811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 215/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:07.964154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:07.964785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:07.971095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:07.971788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:07.972223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:07.973307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:07.973762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:07.974184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:08.109505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:08.116609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5446bf1a-a5dc-4811-a4ff-925b62d95c45 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.156289 Aug 24 07:55:08.117201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 190/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:08.833581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f4b36-7aa5-49d2-b619-ef9af95054de", "name": "network-vif-plugged", "status": "completed", "tag": "a33cc678-e925-41ba-b5d0-1c627df702a4"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:08.839046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=62 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:08.845067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:08.845545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:08.845975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:08.858308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] Creating event network-vif-plugged:a33cc678-e925-41ba-b5d0-1c627df702a4 for instance 996f4b36-7aa5-49d2-b619-ef9af95054de on hv-cinder-85427 Aug 24 07:55:08.863546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-4e05b20b-f3c7-4fc3-97a3-c60d0655f1c1 req-8a478a1e-a24f-4bb4-beb3-71d713822772 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Aug 24 07:55:08.864137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 216/406] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:09.138154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:09.138776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:09.145543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:09.146035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:09.146465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:09.147179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:09.147608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:09.148025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:09.335199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:09.343104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9d3aa812-292d-453c-b144-51885a9524c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.208733 Aug 24 07:55:09.345450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 191/407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:10.366168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:10.366777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:10.373150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:10.373628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:10.374054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:10.374737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:10.375183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:10.375597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:10.511253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:10.519051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac28d10e-a2bf-4d21-9d34-ea12aea6896c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1266 microversion: 2.1 time: 0.157544 Aug 24 07:55:10.520308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 217/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:11.540568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:11.541216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:11.547305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.547774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.548199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.548910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.549349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.549764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.686758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:11.695192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2869edd7-a009-4bb5-95fa-cf02f722462d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1453 microversion: 2.1 time: 0.158576 Aug 24 07:55:11.695750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 192/409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:11.716857 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:11.717497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:11.724346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.724856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.725291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.725973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.726417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.726932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.864345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:11.872158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-05c40856-f8a2-4b7d-8371-e2497f21be43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1453 microversion: 2.1 time: 0.159266 Aug 24 07:55:11.872855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 218/410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:13.903946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996f4b36-7aa5-49d2-b619-ef9af95054de", "tag": "a33cc678-e925-41ba-b5d0-1c627df702a4"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:13.913639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:13.914101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:13.914541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:13.928083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] Creating event network-changed:a33cc678-e925-41ba-b5d0-1c627df702a4 for instance 996f4b36-7aa5-49d2-b619-ef9af95054de on hv-cinder-85427 Aug 24 07:55:13.933240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-47058032-c89b-4dea-96d9-7af597fe7b5e req-eb94f523-6d27-4e78-a51f-65c31668d81d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033037 Aug 24 07:55:13.933846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 193/411] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:19.926189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:19.926715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:19.932885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:19.933363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:19.933795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:19.934476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:19.934926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:19.935347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:19.993001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:20.059052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lazy-loading 'services' on Instance uuid 11a85e76-d571-436c-a306-a993465b6854 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:55:20.311437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-27944655-87bc-4642-8bbc-db9a34b5652a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments/84fb0259-77ee-47ad-b11d-b4a2ffc4d388" status: 202 len: 0 microversion: 2.1 time: 0.389132 Aug 24 07:55:20.312028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 219/412] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:55:19 2022] DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments/84fb0259-77ee-47ad-b11d-b4a2ffc4d388 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:22.484832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:22.491522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.491985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.492439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.494650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=94 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:22.515281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Going to try to stop instance {{(pid=132893) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 07:55:22.836053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5143c0c8-16e4-4bfa-94ee-bd72bc75e39a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action" status: 202 len: 0 microversion: 2.1 time: 0.355348 Aug 24 07:55:22.836710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 194/413] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:55:22 2022] POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:22.846472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:22.847853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:22.854215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.854694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.855121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.855799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.856242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.856678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.890148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:22.895464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:22.897739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.898213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.898708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.899389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.899881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.900292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.924437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-687b4627-38f0-4a02-89db-a4c0d9fef178 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/ips" status: 200 len: 151 microversion: 2.1 time: 0.038496 Aug 24 07:55:22.926005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 195/414] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:55:22 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:55:22.936836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9988780-f40a-4bfd-af08-b42a938053ae"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:22.939172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:22.945531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.945917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.946339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.947063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:22.947500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:22.947911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.991524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:22.999361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fd8c7556-0b73-49e9-bfac-506c43e40e64 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.157752 Aug 24 07:55:23.000012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 220/415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:22 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:23.031964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: POST /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/os-volume_attachments HTTP/1.1 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 74 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:55:23.033722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {"volumeAttachment": {"volumeId": "d9988780-f40a-4bfd-af08-b42a938053ae"}} Aug 24 07:55:23.035750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'server_id': '16139508-8460-4a57-897f-5bcd03173a4a', 'body': {'volumeAttachment': {'volumeId': 'd9988780-f40a-4bfd-af08-b42a938053ae'}}} Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:55:23.036505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:23.038149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 400 to user: Invalid volume: volume d9988780-f40a-4bfd-af08-b42a938053ae is already attached to instances: e0c73c11-2b2f-402b-854b-a59b40417d62 {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a3054e74-e1b3-4629-a0fb-61b0b4d9ab62 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102751 Aug 24 07:55:23.039560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 196/416] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:55:22 2022] POST /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 07:55:23.044931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:23.045575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:23.052321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.052832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.053253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.054195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.054636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.055198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.080628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:55:23.386918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7074f6c1-5b66-4cd7-a05d-29826ad3f47a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 204 len: 0 microversion: 2.1 time: 0.345647 Aug 24 07:55:23.387496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 221/417] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:55:23 2022] DELETE /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:55:23.396181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:23.396819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:23.403709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.404186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.404610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.405324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.405765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.406174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.540168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:23.547857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-31c6cf4c-ae71-47e8-8635-ed28534918d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1684 microversion: 2.1 time: 0.156122 Aug 24 07:55:23.548410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 197/418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:23 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:24.021819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:24.027783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:24.029719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.029981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.030416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.031106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.031555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.031977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.165387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:24.173475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0a9ba9a2-b98d-4311-ab8f-d132e0728627 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.156262 Aug 24 07:55:24.174034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 222/419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:24 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:24.568862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:24.569458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:24.571392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=38 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.575950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.577527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.577527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.577771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.578201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.578607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.711177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:24.718806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9b95e833-3d97-4747-9994-9c845ea8a245 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1684 microversion: 2.1 time: 0.154609 Aug 24 07:55:24.719359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 198/420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:24 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:25.195213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:25.195733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:25.202317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.202792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.203221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.203902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.204377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.204828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.338605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:25.346396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-20fd7387-82ef-4a48-b381-cb5bd3c54af8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.155101 Aug 24 07:55:25.347588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 223/421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:25 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:25.739595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:25.740199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:25.746874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.747345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.747790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.748475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.748962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.749368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.941510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:25.949384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6de4a61c-79ee-4809-ba2a-a569ba0dc5ba tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1684 microversion: 2.1 time: 0.213896 Aug 24 07:55:25.950263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 199/422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:25 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1684 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:26.370434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:26.372009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:26.381240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.381934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.382668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.383375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.383824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.384332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.521053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:26.529768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3741bf54-961a-4b53-8cce-336e13c2fff8 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.163849 Aug 24 07:55:26.530509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 224/423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:26 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:26.609253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16139508-8460-4a57-897f-5bcd03173a4a", "name": "network-vif-deleted", "tag": "fb57dc93-e31e-4602-9e4c-07e407805e15"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:26.620858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.621416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.622042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.635353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] Creating event network-vif-deleted:fb57dc93-e31e-4602-9e4c-07e407805e15 for instance 16139508-8460-4a57-897f-5bcd03173a4a on hv-cinder-85427 Aug 24 07:55:26.640785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-cb14d6f0-13f5-48cd-97b4-f7454b717a6c req-8507bd14-1d2c-4d03-8d93-143673906b88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036052 Aug 24 07:55:26.641732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 200/424] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:26.973030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:26.974046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:26.980276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.981013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.981621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.982586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.983192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.984160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.025423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:27.025925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:27.026400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.026852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lazy-loading 'fault' on Instance uuid 16139508-8460-4a57-897f-5bcd03173a4a {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:55:27.071422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:27.082552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a8946fd-f36b-48d1-b182-0f6883820991 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 200 len: 1332 microversion: 2.1 time: 0.114710 Aug 24 07:55:27.083260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 225/425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:26 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:27.555154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:27.556394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:27.564346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:27.565017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:27.566153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.567018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:27.567573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:27.568076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.761723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:27.772078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c8ed82fc-3e19-47dc-86e2-cc7b7c7e56f6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.222270 Aug 24 07:55:27.772795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 201/426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:27 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:28.103975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:28.104589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:28.111023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.111484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.111919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.113213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.113808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.114235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.127890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a HTTP/1.1 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:55:28.129573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 07:55:28.131098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '16139508-8460-4a57-897f-5bcd03173a4a'} Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:28.131962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 07:55:28.133489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.134762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:28.134762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7320cf30-bad4-4794-b0a3-86352584b0bc tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 404 len: 111 microversion: 2.1 time: 0.030901 Aug 24 07:55:28.134762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 226/427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:28 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:28.139982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6f5d233-be6f-4359-be6d-56f491decda4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '.version_select at 0x7f45680c9ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:28.266796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6f5d233-be6f-4359-be6d-56f491decda4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926459457" status: 202 len: 0 microversion: 2.1 time: 0.130499 Aug 24 07:55:28.267391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 202/428] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Aug 24 07:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926459457 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:28.796482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:28.796482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:28.806977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.807533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.807958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.808665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.809104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.809514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.951675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:28.955679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c97100a0-21f4-4b0d-8085-1be6e96d609e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.163975 Aug 24 07:55:28.956396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 227/429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:28 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:29.141630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:29.148403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:29.149098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.149601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.150031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.150712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.151154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.151567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.273648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lazy-loading 'services' on Instance uuid e0c73c11-2b2f-402b-854b-a59b40417d62 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:55:29.557144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e4ab662d-31b2-4767-9a71-8dc9fd36c407 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments/d9988780-f40a-4bfd-af08-b42a938053ae" status: 202 len: 0 microversion: 2.1 time: 0.419423 Aug 24 07:55:29.557736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 203/430] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:55:29 2022] DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments/d9988780-f40a-4bfd-af08-b42a938053ae => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:29.566782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:29.569062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:29.576525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.577036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.577469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.578220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.578640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.579066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.612728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d968b613-6aa1-4d0a-b469-336cd1487883 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Aug 24 07:55:29.613317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 228/431] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:55:29 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:29.976901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:29.977536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:29.983664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.984138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.984565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.985269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.985712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.986125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:30.137173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:30.145287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cd6943a7-1381-4ec9-a87f-9aed4d66a352 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.172732 Aug 24 07:55:30.145940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 204/432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:29 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:30.625066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:30.627168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:30.633852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:30.634323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:30.634748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:30.635420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:30.635854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:30.636264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:30.667507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d4299809-126d-48bf-831f-ef8dae4405db tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Aug 24 07:55:30.668064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 229/433] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:55:30 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:31.166099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:31.166815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:31.172950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.173432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.173865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.175303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.175557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.176048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.317363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:31.321277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2a2b2c38-1024-4396-9f96-c6a03cdf342c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.158882 Aug 24 07:55:31.337227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 205/434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:31 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:31.679865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:31.682087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:31.688433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.688942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.689365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.690040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.690511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.690918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.720107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58535241-4a7c-4b1e-9599-8a6c0c4b3539 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044042 Aug 24 07:55:31.720685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 230/435] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:55:31 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:55:31.790436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:31.790917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:31.796931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.801518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.801518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.801518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:31.801518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:31.801909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.825146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:55:32.213765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-415b12ea-9fc0-444d-9b75-9e720f2de89e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 204 len: 0 microversion: 2.1 time: 0.426975 Aug 24 07:55:32.214375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 206/436] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:55:31 2022] DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:55:32.222525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:32.223190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:32.229022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.229491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.229922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.230591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.231032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.231450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.345268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:32.346141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:32.356558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.357148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.357615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.358318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.358927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.359506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.373966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:32.383484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-243d1926-b449-4de5-92e6-f01f2ce175c8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1682 microversion: 2.1 time: 0.164647 Aug 24 07:55:32.384135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 231/437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:32 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:32.516556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:32.525126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f7626acb-fdb6-4c7a-b81a-3d265c83b5e7 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.185138 Aug 24 07:55:32.525692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 207/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:32 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:33.405567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:33.406178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:33.413531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.414012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.414446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.415141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.415591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.416018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.546616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:33.547307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:33.547675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:33.553567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.554247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.554746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.555535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.555875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7136698e-d078-45cf-b524-261f9120ff4b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1682 microversion: 2.1 time: 0.154139 Aug 24 07:55:33.556061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.556442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 232/439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:33 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:33.556587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.703182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:33.712128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d1d79746-02ed-49de-a0b2-f9ae44481be9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1678 microversion: 2.1 time: 0.169495 Aug 24 07:55:33.714822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 208/440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:33 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:34.577494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:34.578107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:34.585532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.585952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.586387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.587075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.587526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.587944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.733614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:34.735700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:34.738473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:34.742274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.743062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.743553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.744495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.744948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.745450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.761774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:34.767349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-06d4ed9f-5204-47c1-9e91-ad406b37c720 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1682 microversion: 2.1 time: 0.193867 Aug 24 07:55:34.781390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 233/441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:34 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:34.949725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:34.958430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96f7454c-6b88-4e3d-b1a1-ed4b3dd56287 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1655 microversion: 2.1 time: 0.228865 Aug 24 07:55:34.958989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 209/442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:34 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1655 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:34.978964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:34.984944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.985413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.985838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.011334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:35.044754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Going to try to start instance {{(pid=132892) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 07:55:35.270896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e91bf2c4-7507-43e5-93e2-5e101431ab6d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action" status: 202 len: 0 microversion: 2.1 time: 0.295582 Aug 24 07:55:35.271724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 234/443] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:55:34 2022] POST /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:55:35.279991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.280844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:35.288457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.288952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.289383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.290071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.290512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.290933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.430279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c73c11-2b2f-402b-854b-a59b40417d62", "name": "network-vif-deleted", "tag": "9e06eb90-2417-4cb1-9633-e5840b590cb3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:35.460598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.461918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.462580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.481925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] Creating event network-vif-deleted:9e06eb90-2417-4cb1-9633-e5840b590cb3 for instance e0c73c11-2b2f-402b-854b-a59b40417d62 on hv-cinder-85427 Aug 24 07:55:35.496572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:35.497097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-7b4d647b-135e-482c-97ab-b727188eb821 req-8d693291-61a3-49fc-8aa0-aa6b9cd9de3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060907 Aug 24 07:55:35.497097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 235/444] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:35.497258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ee835ae3-f12a-4da6-9568-2e59e793473d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1664 microversion: 2.1 time: 0.218603 Aug 24 07:55:35.506022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 210/445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:35 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:35.788927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.789794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:35.789955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1712154233", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "networks": [{"uuid": "d9679161-d305-4d3b-b7e0-280c7b6b919f"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:35.796138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.796881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.797500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.798358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.798977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.800087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.840243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.841025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.841507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.842116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lazy-loading 'fault' on Instance uuid e0c73c11-2b2f-402b-854b-a59b40417d62 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:55:35.919308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:35.928820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-430d5b68-236c-4377-b771-10eee21a0f3e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 200 len: 1331 microversion: 2.1 time: 0.143749 Aug 24 07:55:35.929394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 211/446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:35 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:35.932688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] validate_networks() for [('d9679161-d305-4d3b-b7e0-280c7b6b919f', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:36.322158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:36.322569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:36.323328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:36.323731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:36.324193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:36.334390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.335158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.335578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.336287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.336901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.337312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.355651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Getting quotas for project 05b468fa5d3046ebb37fbd43102be471. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:36.359839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Getting quotas for user ab1a288170374d1a80355c869c78b4ca and project 05b468fa5d3046ebb37fbd43102be471. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:36.371875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:36.374368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:36.519199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:36.520188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:36.526544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.527153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.527834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.528802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.529351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.529837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.577982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-463ce6df-cd76-4bda-893e-2b5c4143ea89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792590 Aug 24 07:55:36.578920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 236/447] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:55:36.590884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae113876-7c01-4f46-9d88-f8300f8523c6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:36.591643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae113876-7c01-4f46-9d88-f8300f8523c6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:36.673875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae113876-7c01-4f46-9d88-f8300f8523c6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:36.683861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae113876-7c01-4f46-9d88-f8300f8523c6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1219 microversion: 2.1 time: 0.097012 Aug 24 07:55:36.689128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 237/448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:36 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:36.701372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:36.712697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d59d69ef-ed03-42e5-83b8-04d87baffb88 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1664 microversion: 2.1 time: 0.195711 Aug 24 07:55:36.712697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 212/449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:36 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:36.949734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:36.950286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:36.958208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.958697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.959120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.959791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.960228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.960638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.973786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 HTTP/1.1 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:55:36.975414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 07:55:36.977010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': 'e0c73c11-2b2f-402b-854b-a59b40417d62'} Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:36.977991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 07:55:36.979516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.980967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:36.980967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f18ea2c6-240d-4eaf-bb31-6c6c8d4257a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 404 len: 111 microversion: 2.1 time: 0.030878 Aug 24 07:55:36.980967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 238/450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:36 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:36.985432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-94d32fbb-525d-4afd-8565-9e44e1bdf908 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '.version_select at 0x7f45681c78b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.079352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-94d32fbb-525d-4afd-8565-9e44e1bdf908 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812510477" status: 202 len: 0 microversion: 2.1 time: 0.097541 Aug 24 07:55:37.079947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 213/451] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 24 07:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812510477 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:37.399521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aa120b3-1777-4acb-921c-5f489808cb89"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:37.402216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:37.408559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.409151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.409611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.410506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.411023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.411448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.707268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.707891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:37.713785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.714259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.714683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.715451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.715861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.716275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.776911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:37.784941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d77d5aaa-eec6-4eb4-b2a3-ca6b3e11f377 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1223 microversion: 2.1 time: 0.081594 Aug 24 07:55:37.785496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 214/452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:37 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:37.799018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.799018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:37.799018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.799018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.800156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.800156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.800156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.800443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.988287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:37.996163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-07aba134-17cb-4bdd-bc73-dd639a31b96e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1668 microversion: 2.1 time: 0.209639 Aug 24 07:55:38.000981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 215/453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:37 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1668 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:38.001094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6fa80819-9bb5-4705-9b2a-fa5e180cf680 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: .version_select at 0x7f456809b9d0>, body: {"keypair": {"name": "tempest-keypair-800774132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEliV84d5yG/ce6WYYA8ikhH6X5zb19QRYKy9X8ZS4uhzWm8u0VGZXlPxmEDdEmQyA0iR/tQU7qIr1DgTs/6tETeDZgsy9+rRhxbDQo53TX7jJi+OxaR2HotEw1NvYTUkA=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:38.015949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-6fa80819-9bb5-4705-9b2a-fa5e180cf680 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:38.020663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-6fa80819-9bb5-4705-9b2a-fa5e180cf680 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:38.182178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6fa80819-9bb5-4705-9b2a-fa5e180cf680 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184435 Aug 24 07:55:38.182756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 216/454] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:55:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:38.351498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a7c7d36a-206d-4d3f-9d04-8c8849c81159 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956086 Aug 24 07:55:38.352108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 239/455] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:55:37 2022] POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments => generated 194 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:38.805765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:38.806373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:38.812421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:38.812935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:38.813371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:38.814124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:38.814575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:38.815191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:38.884566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:38.892203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2da03883-7d4a-432f-8b83-4870477a0820 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1271 microversion: 2.1 time: 0.090305 Aug 24 07:55:38.892799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 217/456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:38 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:39.918596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:39.919416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:39.925821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:39.926303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:39.926733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:39.927420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:39.927866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:39.928285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:40.350261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:40.358284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d08b144-7fb3-4f67-bf0d-73ffb33f30a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.444460 Aug 24 07:55:40.358942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 240/457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:39 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:40.859832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e23b0b-dfe5-497c-bee6-4d3aa5271ddc", "tag": "210bc4fa-dfa0-481d-941d-906cf4b8f62c"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:40.869458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:40.869928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:40.870347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:40.881832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] Creating event network-changed:210bc4fa-dfa0-481d-941d-906cf4b8f62c for instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc on hv-cinder-85427 Aug 24 07:55:40.886577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-3e6db390-013a-410e-af5d-598f25713f74 req-895972d1-7a61-4a58-b34c-190264cbe392 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030477 Aug 24 07:55:40.887199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 218/458] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:41.062001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-879652273", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25fc9eb1-bc13-4133-b4c8-3baba837afc7"}], "security_groups": [{"name": "tempest-securitygroup--1770326411"}], "key_name": "tempest-keypair-800774132", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:41.071518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:41.167271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] validate_networks() for [('25fc9eb1-bc13-4133-b4c8-3baba837afc7', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:41.384699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:41.385411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:41.391947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.395717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.395717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.395717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.395717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.396144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.559460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:41.559871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:41.560332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:41.560752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:41.561155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:41.570738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.571241 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.571667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.572382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.572849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.573263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.592455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:41.597754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:41.610299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:41.613719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:41.761150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-72ccc869-bbf3-42fa-977b-0a922e1432e2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.703260 Aug 24 07:55:41.767359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 241/459] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:55:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:55:41.773010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f9226c5-7675-4352-893c-b401a8e2ec23 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:41.773617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f9226c5-7675-4352-893c-b401a8e2ec23 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:41.832489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f9226c5-7675-4352-893c-b401a8e2ec23 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:41.841211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f9226c5-7675-4352-893c-b401a8e2ec23 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1240 microversion: 2.1 time: 0.071693 Aug 24 07:55:41.842154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 242/460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:41 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:41.876077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:41.895801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b816a709-57ba-4d3e-a9b1-e74af5de30f1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.516059 Aug 24 07:55:41.900752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 219/461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:41 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:42.861316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:42.862611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:42.869030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.869501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.876864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.876864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.876864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.876864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.920421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:42.924956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:42.928127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.928705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.929205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.929960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.930479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.930967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.938407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:42.946143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-640b556f-2245-4886-a4fe-71b6f9ba75ce tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1244 microversion: 2.1 time: 0.088659 Aug 24 07:55:42.946712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 243/462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:42 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:43.058950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:43.067182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a2389d6b-929d-4785-af6b-45b4af963174 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.150628 Aug 24 07:55:43.067745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 220/463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:42 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:43.966960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:43.967505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:43.974000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.974469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.974895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.975573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.976016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.976438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.039296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:44.046904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0d0b90ee-0caa-4be2-982b-7a0c9a2f0e89 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1292 microversion: 2.1 time: 0.083926 Aug 24 07:55:44.047486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 244/464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:43 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:44.088489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:44.089175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:44.095283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.095761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.096474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.097480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.098096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.098548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.231426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:44.240229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8aed9307-12fc-4cc2-a1c7-21a3fd0114a5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.155485 Aug 24 07:55:44.240821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 221/465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:44 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.069513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:45.070290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.077087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.077572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.078001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.078719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.079167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.079783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.219681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.224769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cf60bbc7-b4a8-403c-98f0-43b3ad79a07a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.159010 Aug 24 07:55:45.225344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 245/466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:45 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.262925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:45.263534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.270018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.270501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.270929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.271620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.272067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.272484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.473760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.483934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-391765a6-915d-4a0f-b60c-f3d3c68126b2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.224954 Aug 24 07:55:45.484525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 222/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:45 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.895006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:45.897518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.904671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.910059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.910059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.910059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.910059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.910417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.933477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'flavor' on Instance uuid 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:55:46.196129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa9852-e8b2-470f-aeb4-e4e442384feb", "tag": "a0b691d2-8c21-4e34-9215-d5f0daade5a7"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:46.206859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.207529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.207958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.219464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] Creating event network-changed:a0b691d2-8c21-4e34-9215-d5f0daade5a7 for instance 77aa9852-e8b2-470f-aeb4-e4e442384feb on hv-cinder-85427 Aug 24 07:55:46.224962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-7e102d50-76fb-41ee-a6c6-badf04aa2f47 req-55f7f032-c068-49d4-8378-47025d974780 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Aug 24 07:55:46.225841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 223/468] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:46.246598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.247314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.253751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.254236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.254710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.255405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.255857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.256278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.293185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-792ad8d4-0448-4651-bfbf-4caab1a8bc52 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/action" status: 200 len: 32 microversion: 2.1 time: 0.402291 Aug 24 07:55:46.298533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 246/469] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:55:45 2022] POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:55:46.304508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.305243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.312052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.312602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.313065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.313792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.314245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.314746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.461624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.473480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a686b008-96b1-47e8-8de2-10e0bfca92f1 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.173555 Aug 24 07:55:46.474177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 247/470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:46.496358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.503518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f2c4730-02b1-439d-bd48-0b9d8f391ab6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.261234 Aug 24 07:55:46.504096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 224/471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:46.504448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.505186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.512045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.512943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.513643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.514551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.515214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.515842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.730641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.739296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ded87b3f-17b6-45d0-ae05-e230e3368808 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.239012 Aug 24 07:55:46.739883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 248/472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:47.049408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e23b0b-dfe5-497c-bee6-4d3aa5271ddc", "name": "network-vif-plugged", "status": "completed", "tag": "210bc4fa-dfa0-481d-941d-906cf4b8f62c"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:47.059451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.059923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.060345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.073701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] Creating event network-vif-plugged:210bc4fa-dfa0-481d-941d-906cf4b8f62c for instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc on hv-cinder-85427 Aug 24 07:55:47.079144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-8e8a36f2-8872-4315-b146-e0bc4c810fa0 req-621b9a94-a83e-4b1a-ac87-aa3e83bbe9c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Aug 24 07:55:47.079830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 225/473] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:47.495135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.495698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.502196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.502674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.503106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.503790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.504235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.504671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.524523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.525251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.536383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.536911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.537351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.538051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.538564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.538983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.641194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.650482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb84a27a-b965-4b63-a8bf-e4e0bfdcfe39 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.159207 Aug 24 07:55:47.651065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 249/474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:47.677241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.684789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6752ee6a-435f-492b-b186-17c31572cc6f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.164355 Aug 24 07:55:47.685402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 226/475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:47.760544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.761117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.767014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.767516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.772891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.772891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.772891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.772891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.896718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.904344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7d83538e-ae78-49d8-b50f-7617f380b106 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.147731 Aug 24 07:55:47.904930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 250/476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:48.673254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.674267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.676251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=4 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.681019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.681493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.681922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.682602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.683046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.683464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.706131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.706803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.713429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.714080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.714590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.715379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.715926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.716462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.721587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.815671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.824930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30c01bad-5bd6-4dc2-9f02-349fd9c62179 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.154557 Aug 24 07:55:48.825509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 227/477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:48.854325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.861948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f7fcdc2d-0a66-48f9-b6aa-8dacaf5342e8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.160281 Aug 24 07:55:48.862512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 251/478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:48.926600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.927132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.933067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.933534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.933956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.934640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.935058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.935467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.062077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.070523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-86db5e13-4ed8-408b-b8fc-603df5cfa00e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.148689 Aug 24 07:55:49.071083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 228/479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:49.846631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.847569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.854045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.854518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.854942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.855616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.856083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.856492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.882636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.883234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.889177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.889646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.890069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.890746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.891190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.891603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.986245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.995160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f8516bc3-2ccb-4752-84f1-5219ee885f0f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.152304 Aug 24 07:55:49.995732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 252/480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:50.025590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:50.027744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.034194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dd2b0e3c-4c63-4787-aa6c-66e43235eb6a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.155157 Aug 24 07:55:50.034753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 229/481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:50.091172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:50.092016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:50.098056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.098477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.098908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.099581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.100028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.100444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.230135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:50.238295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d3dbbea-ff8c-4c05-9af3-be55499fb455 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1319 microversion: 2.1 time: 0.150925 Aug 24 07:55:50.238859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 253/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:50 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:51.016597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.017226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.024307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.024816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.025259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.025958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.026411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.026839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.059634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.060292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.067578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.068106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.070507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.070507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.070507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.070507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.167068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.175672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-247b9ad4-a6e1-4eaa-a5e3-bf1b02236fac tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.163038 Aug 24 07:55:51.181786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 230/483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:51.203926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.212153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9bb73177-d918-4c4a-9e85-0f7a7f1ffa18 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.157646 Aug 24 07:55:51.212807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 254/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:51.259178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.259789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.265755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.266233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.266667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.267348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.267878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.268305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.398846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.406534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-522dae2d-aadb-4ccc-8750-078d8f03f8f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1509 microversion: 2.1 time: 0.151236 Aug 24 07:55:51.407108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 231/485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:52.197214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:52.197911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:52.199809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:52.200878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=16 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:52.207029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.207511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.207943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.208633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.209106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.209522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.233886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:52.234528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:52.241734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.242341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.242772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.243463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.243935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.244352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.346066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.354375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7aec6322-2a85-4266-b21d-86ccefd03aa3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.160987 Aug 24 07:55:52.355147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 255/486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:52 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:52.387595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.395263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1146da7b-6519-4358-8c0b-6c7ff09e2059 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.165352 Aug 24 07:55:52.395825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 232/487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:52 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:53.212223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa9852-e8b2-470f-aeb4-e4e442384feb", "name": "network-vif-plugged", "status": "completed", "tag": "a0b691d2-8c21-4e34-9215-d5f0daade5a7"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:53.223390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.223864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.224287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.237244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] Creating event network-vif-plugged:a0b691d2-8c21-4e34-9215-d5f0daade5a7 for instance 77aa9852-e8b2-470f-aeb4-e4e442384feb on hv-cinder-85427 Aug 24 07:55:53.242409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-3aee98e7-02ad-4b99-a693-1788960997b7 req-87ecf176-0d4b-45ce-b014-e215c16bc824 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 Aug 24 07:55:53.242993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 256/488] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:53.375799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.376446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.383570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.384038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.384461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.385166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.385604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.386014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.416620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.417571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.426019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.426788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.427384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.428086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.429802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.430810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.525251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:53.539732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-985a6473-82d1-451c-b0f4-185d4f8cb38f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.162721 Aug 24 07:55:53.539732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 233/489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:53.581216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:53.588911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e8ba263-0d79-4a71-8c96-48c7bf69ed59 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.176928 Aug 24 07:55:53.589506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 257/490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:54.558863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:54.559497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:54.566814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.567312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.567739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.568431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.568933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.569352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.612676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:54.613287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:54.621124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.621613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.622050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.622892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.623347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.624075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.716374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.726239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-42f16526-9a4f-4efe-9bb5-940f89f61684 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.171763 Aug 24 07:55:54.726902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 234/491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:54 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:54.776110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.784993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4fc3a35b-7f9c-491c-9569-43ecadfd85e1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.177878 Aug 24 07:55:54.785565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 258/492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:54 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:55.748091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:55.748618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:55.750470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.755183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.755649 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.756069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.756769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.757208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.757688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.805884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:55.817012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:55.817012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.817012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.817012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.817442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.817442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.817442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.899437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:55.909079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b9d97c65-8631-4c8b-8698-273fc25d7467 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.164132 Aug 24 07:55:55.909864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 235/493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:55 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:55.954827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:55.962577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-856bb11c-feb1-4d22-88be-88f02b450ebe tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1366 microversion: 2.1 time: 0.160532 Aug 24 07:55:55.963134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 259/494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:55 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:56.932407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:56.933077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:56.941119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.941684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.942200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.943043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.943497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.943922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.983162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:56.983761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:56.990363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.990850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.991285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.991976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.992426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.992881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.084985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:57.091635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-005e02c9-07e7-4859-bc26-3b330db485f7 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.163494 Aug 24 07:55:57.092600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 236/495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:56 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:57.130157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:57.137871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff744a9b-7b15-4475-ac33-b2b80fce2618 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1557 microversion: 2.1 time: 0.158460 Aug 24 07:55:57.138434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 260/496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:56 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:57.159211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:57.159732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:57.165670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.166139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.166571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.167251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.167698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.168112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.245530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-88f5f529-267e-46c3-9cc9-8ee10b022606 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090701 Aug 24 07:55:57.246135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 237/497] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:55:57 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:58.114273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:58.115048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:58.122206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.122681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.123111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.123796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.124241 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.124718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.251049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa9852-e8b2-470f-aeb4-e4e442384feb", "tag": "a0b691d2-8c21-4e34-9215-d5f0daade5a7"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:58.262211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.262864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.263444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.265217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:58.275330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ee903da-8e9b-487d-a654-fbeacc0d2511 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.165825 Aug 24 07:55:58.275767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] Creating event network-changed:a0b691d2-8c21-4e34-9215-d5f0daade5a7 for instance 77aa9852-e8b2-470f-aeb4-e4e442384feb on hv-cinder-85427 Aug 24 07:55:58.276187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 261/498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:58 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:58.281004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-b43ad5c2-542c-444b-b8cf-cfb37f8db5f5 req-6d38bbe9-a604-4cac-9b3a-eeefb38dd9a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033721 Aug 24 07:55:58.281954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 238/499] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:55:59.296846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:59.297411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:59.304220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.304725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.305154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.305823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.306264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.306673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.443767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.452370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14acd03e-733b-4928-a3cd-50ba7d03b6c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.159520 Aug 24 07:55:59.452952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 262/500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:59 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:00.475126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:00.475724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:00.482005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.482475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.482900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.483573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.484013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.484427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.622608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:00.631486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-16baaba0-4de6-4da6-b0c8-af4d21bb313e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.161207 Aug 24 07:56:00.632062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 239/501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:00 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:01.653214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:01.653860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:01.661067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.661549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.661980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.662664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.663114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.663531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.798641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:01.807027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-034ae4e8-2d74-4d27-8c84-498892395e56 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.157663 Aug 24 07:56:01.807574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 263/502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:01 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:02.829107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:02.830384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:02.836462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.836967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.837392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.838060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.838497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.838905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.968169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.977304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-484d1e0c-7eb0-4122-90f2-c97aa7d8e8e9 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.152306 Aug 24 07:56:02.977864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 240/503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:02 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:03.998962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:03.999696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:04.006342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.006864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.007316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.008000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.008445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.008967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.142822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:04.152130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f20f098-ad01-4afa-a253-9d5c1fb03a20 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.157017 Aug 24 07:56:04.152722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 264/504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:03 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:05.174949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:05.175486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:05.181458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.181936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.182366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.183077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.183524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.183943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.316220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.324389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eb6d5942-dd90-4d4d-a9a1-96c1f48b0968 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1732 microversion: 2.1 time: 0.153865 Aug 24 07:56:05.324990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 241/505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:05 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:06.345573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.346306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.352742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.353118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.353542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.354210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.354651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.355063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.484186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:06.492788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d74c5195-0141-4e0d-9cfc-76440c5c1225 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1712 microversion: 2.1 time: 0.151240 Aug 24 07:56:06.493361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 265/506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:06.600163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.600787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.607641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.608123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.608554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.609272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.609727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.610153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.696812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] HTTP exception thrown: Cannot 'detach_volume' instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb while it is in vm_state rescued Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Request method failure captured: Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments/2aa120b3-1777-4acb-921c-5f489808cb89 HTTP/1.1 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdikBRAn27k9M6f2KCiv1ag_86tIj8pmXaeEkPajvJ6pZgX4fEXkW6EPiFc7s23Bi0290etk-9ELd2V9lkOYCUy-9uRgXS-9oJ9GUCcLUH9KUWo6dXnDNqfM0OTMxbn6kpJ6V2KMvwI7FqrKVxoJLGbG2gylyqpFChvTkXnJ7rQ3B34 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:56:06.698434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}] Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: e23edadcfe3d4a0b81b13e278682ca2f Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:56:06.700053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Cannot 'detach_volume' instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb while it is in vm_state rescued Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'server_id': '0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb', 'id': '2aa120b3-1777-4acb-921c-5f489808cb89'} Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:06.701141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb while it is in vm_state rescued Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb while it is in vm_state rescued Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:06.702791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Returning 409 to user: Cannot 'detach_volume' instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb while it is in vm_state rescued {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:06.704021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-396e95b9-d23e-471d-8241-a35d422c1bcc tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments/2aa120b3-1777-4acb-921c-5f489808cb89" status: 409 len: 152 microversion: 2.1 time: 0.103627 Aug 24 07:56:06.704638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 242/507] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:56:06 2022] DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments/2aa120b3-1777-4acb-921c-5f489808cb89 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:56:06.709439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:06.710103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.716992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.717352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.717852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.718664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.719182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.719687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.956200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-be6b6670-59c0-4bce-8964-a942e984a19d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/action" status: 202 len: 0 microversion: 2.1 time: 0.250065 Aug 24 07:56:06.959488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 266/508] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:56:06 2022] POST /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:56:06.964601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.965239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.972738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.973224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.973661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.974351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.974806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.975857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:07.105833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.114474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b87cf124-9c52-4bd4-ac03-80b071c0187f tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1720 microversion: 2.1 time: 0.153613 Aug 24 07:56:07.115051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 243/509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:08.137208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:08.137995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:08.144958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.145444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.145876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.146589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.147038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.147453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.166308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:08.281446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.290296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1af1e84-0a67-4bcd-93e3-13359518bde0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1720 microversion: 2.1 time: 0.158023 Aug 24 07:56:08.290861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 267/510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:08 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:09.311243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:09.311875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:09.318035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.318527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.318980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.319657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.320095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.320509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.450133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.458715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0fe6f5ad-00f4-4195-b989-509d8c0bc940 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1720 microversion: 2.1 time: 0.151485 Aug 24 07:56:09.459279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 244/511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:09 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:10.479590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:10.480168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:10.487180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.487653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.488082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.488785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.489235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.489654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.616949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:10.625104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b7f2ace-fe55-4d14-8e07-d7e928277261 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1720 microversion: 2.1 time: 0.149450 Aug 24 07:56:10.625664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 268/512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:10 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:11.220439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "788064b7-fe51-4a68-b569-641d5a81ce10", "device": "/dev/sdb"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:11.223565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:11.229755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.230290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.230719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.231409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.231856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.232271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.646387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:11.647158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:11.649291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:11.654083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.654533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.654958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.655630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.656072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.656484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.787482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.795930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b6ccc72f-8f2d-4101-ba9d-4b8b44b0eb7e tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1726 microversion: 2.1 time: 0.153842 Aug 24 07:56:11.796474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 269/513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:11 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:11.818283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:11.818758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:11.824531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.825076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.825765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.826445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.826889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.827307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.907076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-99810d75-095b-4af7-8d22-5de940610250 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092605 Aug 24 07:56:11.908480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 270/514] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:56:11 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:12.115630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4efe0ff4-a85e-40b3-b7e5-eb39d926dd03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "POST /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899110 Aug 24 07:56:12.116428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 245/515] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:56:11 2022] POST /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:12.853032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:12.863471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.864204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.864753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.879078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] Creating event network-changed:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:56:12.884727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-a95b7c63-99d0-436d-bb17-b876e08e4dba req-bbfb9568-a0bf-4d76-9eb3-b6d735ec2bca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035639 Aug 24 07:56:12.885662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 271/516] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:14.900395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:14.911552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.912016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.912433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.916081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:14.922451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] Creating event network-changed:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:56:14.927647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-ab9322e1-8e9a-44a7-99fb-267653550715 req-82b9a4c8-5ec8-4a1a-bf99-d5812b9adce6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031271 Aug 24 07:56:14.930961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 246/517] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:37.994285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:37.994860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:37.997002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=5 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:37.997674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=20 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:38.002719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.003194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.003626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.004308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.004784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.005204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.087061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:56:38.287506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6fc26a96-fba3-472e-b9a9-d748f473c370 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc/os-volume_attachments/788064b7-fe51-4a68-b569-641d5a81ce10" status: 202 len: 0 microversion: 2.1 time: 0.297457 Aug 24 07:56:38.288042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 272/518] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:56:37 2022] DELETE /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc/os-volume_attachments/788064b7-fe51-4a68-b569-641d5a81ce10 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:56:39.410786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:39.411450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:39.414440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=23 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:39.419753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.420226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.420675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.421364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.421808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.422224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.447402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:56:39.779416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bfd1f8ae-39e3-47bf-8f94-7b940036a863 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 204 len: 0 microversion: 2.1 time: 0.372842 Aug 24 07:56:39.779921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 247/519] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:56:39 2022] DELETE /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:56:39.789266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:39.789962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:39.796161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.796661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.797108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.797786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.798279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.798697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.929106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:39.937009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8f346c37-dfaa-4073-9e55-8a2c3ef041a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1515 microversion: 2.1 time: 0.152528 Aug 24 07:56:39.937580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 273/520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:39 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:40.958876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:40.959560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:40.966069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.966533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.966952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.967616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.968052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.968459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.097841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.105431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-22d888f4-0a3d-44c0-a825-62fd6e7a964e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1515 microversion: 2.1 time: 0.150837 Aug 24 07:56:41.105976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 248/521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:40 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:41.356049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.358333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.364860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.365338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.365839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.366434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.366878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.367292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.396318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-525a9d84-4ca8-4911-87af-80f7eb7966b2 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044257 Aug 24 07:56:41.396898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 274/522] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:56:41.456832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.457313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.463357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.463825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.464247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.464942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.465382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.465796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.492235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:56:41.783426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-db36de30-a7da-401d-9069-248c28bb0371 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 204 len: 0 microversion: 2.1 time: 0.330598 Aug 24 07:56:41.784010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 249/523] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:56:41 2022] DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:56:41.792353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.793013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.799844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.800326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.800784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.801471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.801923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.802338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.966350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.974404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2c1bb4da-af20-4682-a597-0c76b9b82f7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1674 microversion: 2.1 time: 0.186072 Aug 24 07:56:41.976386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 275/524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.126528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.127275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:42.133237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.133706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.134135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.134893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.135343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.135774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.263305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:42.271351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2c83ce79-578e-4883-af75-b1549b5b5fa4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1515 microversion: 2.1 time: 0.149062 Aug 24 07:56:42.271912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 250/525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.996159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.996749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.003211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.003687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.004117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.004830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.005279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.005696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.132094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.139805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ea266807-8ac3-47d4-9b41-f2c44fdefc19 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1674 microversion: 2.1 time: 0.147593 Aug 24 07:56:43.140380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 276/526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:43.293040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:43.293566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.299947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.300433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.300885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.301570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.302014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.302429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.431816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.439412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2dc02e49-fe54-41ca-90d4-eaac424e0db8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1515 microversion: 2.1 time: 0.150363 Aug 24 07:56:43.440062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 251/527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:43 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:44.160953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.161565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.168549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.169170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.169696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.170568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.171070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.171583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.343955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:44.352750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eda417c6-efa0-4bb5-ad90-fecb9391b50b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1674 microversion: 2.1 time: 0.195766 Aug 24 07:56:44.353347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 277/528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:44.461860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.462741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.471291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.471944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.472832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.482629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.482629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.482629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.502360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e23b0b-dfe5-497c-bee6-4d3aa5271ddc", "name": "network-vif-deleted", "tag": "210bc4fa-dfa0-481d-941d-906cf4b8f62c"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:44.512497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.513029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.513445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.530580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] Creating event network-vif-deleted:210bc4fa-dfa0-481d-941d-906cf4b8f62c for instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc on hv-cinder-85427 Aug 24 07:56:44.536664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-bb8bf332-da0b-4d23-bb1e-26b012d78ed0 req-e69eddf8-069f-426d-b348-cf78b16dc3eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038450 Aug 24 07:56:44.537527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 278/529] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:44.647878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:44.655694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3f931fe-1683-4c84-9288-3467c30fbf5b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1473 microversion: 2.1 time: 0.197921 Aug 24 07:56:44.656261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 252/530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1473 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:45.247848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a85e76-d571-436c-a306-a993465b6854", "name": "network-vif-deleted", "tag": "ea9401db-567f-4e69-9418-66ab277544ea"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:45.258321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.258794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.259222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.271973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] Creating event network-vif-deleted:ea9401db-567f-4e69-9418-66ab277544ea for instance 11a85e76-d571-436c-a306-a993465b6854 on hv-cinder-85427 Aug 24 07:56:45.276950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-db200c51-aed3-4617-ae8b-16281f6f7b43 req-d8f4ed26-14b5-42be-b157-4a025e07c57e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Aug 24 07:56:45.277553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 279/531] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:45.374285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:45.377787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:45.394794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.395646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.396158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.396994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.398278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.399295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.488255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:45.496762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84544c1a-2f34-4cf9-8e58-0f32b955336a tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 200 len: 1606 microversion: 2.1 time: 0.126596 Aug 24 07:56:45.501690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 253/532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:45 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 1606 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:45.678380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:45.679326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:45.685807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.686286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.686898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.687752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.688271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.688716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.723488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.723876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.724305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.724768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'fault' on Instance uuid 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:56:45.767910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:45.775772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac72ccf3-6244-42fc-b53f-0d646a73bdab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 200 len: 1309 microversion: 2.1 time: 0.102718 Aug 24 07:56:45.776547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 280/533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:45 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:46.519283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.519883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:46.526281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.526762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.527192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.527900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.528329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.528769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.542974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 HTTP/1.1 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:56:46.544627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 07:56:46.546261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '11a85e76-d571-436c-a306-a993465b6854'} Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:46.547333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 07:56:46.549039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.550545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:46.550545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-77defd53-92f2-4083-9e58-16465c05725c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 404 len: 111 microversion: 2.1 time: 0.031276 Aug 24 07:56:46.550545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 254/534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:46 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:46.555034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8f834142-3a5c-4144-8c50-d8f1160cf5ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '.version_select at 0x7f4562dbe5e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.677678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8f834142-3a5c-4144-8c50-d8f1160cf5ef tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916936101" status: 202 len: 0 microversion: 2.1 time: 0.126311 Aug 24 07:56:46.678339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 281/535] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 24 07:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916936101 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:56:46.797358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.797959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:46.804126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.804590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.805053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.805724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.806163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.806571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.820343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] HTTP exception thrown: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Request method failure captured: Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc HTTP/1.1 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdl1Qn076i86puRCzMLA3WTs3HXoAiWMhPnNkO458eXmJQXX7F1JYuB2H93kTtMjeP3CnoDjcg3CEwUpx5WnLBcuIs7An_vDtJYUKjhT2j0Z5Oeo1xJHC6tkZDD7aCR5qD2v5JO6eLiwqR__ITswAZEGMSAvgVCida8AGo4JNASY8ng Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:56:46.821871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}] Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: ab1a288170374d1a80355c869c78b4ca Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. Aug 24 07:56:46.823392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '36e23b0b-dfe5-497c-bee6-4d3aa5271ddc'} Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:46.824671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. Aug 24 07:56:46.826166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:56:46.827386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Returning 404 to user: Instance 36e23b0b-dfe5-497c-bee6-4d3aa5271ddc could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:46.827386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b6882c7a-7ef3-4ce0-b519-98476b7aacee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc" status: 404 len: 111 microversion: 2.1 time: 0.030068 Aug 24 07:56:46.827386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 255/536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:46 2022] GET /compute/v2.1/servers/36e23b0b-dfe5-497c-bee6-4d3aa5271ddc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:47.519823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1af079ae-80d9-4cb4-93e7-f7b5264f3673 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'create', calling method: .version_select at 0x7f4562edb040>, body: {"keypair": {"name": "tempest-keypair-1655937466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgjjL8EpYvfBv8SoiN730jHWexktNOVsWEe5tiThg1NYmKL8WTa7VpadPn0D2bl5Cg1cuk1AHKjyoJUVtv9xwGSNwWsq6cisoEB7LmVk9KxY/4MNUJDhb4LS34Km3N12A=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:47.536586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-1af079ae-80d9-4cb4-93e7-f7b5264f3673 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:56:47.540473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-1af079ae-80d9-4cb4-93e7-f7b5264f3673 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for user 2ec3daa674814619976aead75459e98c and project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:56:47.649141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1af079ae-80d9-4cb4-93e7-f7b5264f3673 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133232 Aug 24 07:56:47.649805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 282/537] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:56:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:50.055908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1836077570", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c872f00-7b0e-4d56-a4cb-c524766bac52"}], "security_groups": [{"name": "tempest-securitygroup--1514057287"}], "key_name": "tempest-keypair-1655937466", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:50.321586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] validate_networks() for [('6c872f00-7b0e-4d56-a4cb-c524766bac52', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:56:50.694746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:56:50.695154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:56:50.695610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:56:50.696050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:56:50.696447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:56:50.706282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.706749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.707168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.707880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.708381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.708833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.725339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:56:50.729359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Getting quotas for user 2ec3daa674814619976aead75459e98c and project d7043fd37a1040c2af5d3f9f2943a791. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:56:50.741360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:56:50.743656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:56:50.895197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ba2ee756-abe3-45c3-8aa4-584ee75349ec tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.843627 Aug 24 07:56:50.895875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 256/538] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:56:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:56:50.907535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa9bc639-a683-47a0-b445-111b0cda318e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:50.908315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa9bc639-a683-47a0-b445-111b0cda318e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:51.017123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa9bc639-a683-47a0-b445-111b0cda318e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:51.023847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa9bc639-a683-47a0-b445-111b0cda318e tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1238 microversion: 2.1 time: 0.121026 Aug 24 07:56:51.024823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 283/539] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:50 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:52.044583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:52.045239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:52.051833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.052303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.052753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.053425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.053865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.054279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.116764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:52.124441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a5337ec5-3a2e-4066-8fde-3fb3b275a350 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1242 microversion: 2.1 time: 0.083697 Aug 24 07:56:52.125029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 257/540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:52 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:53.146955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.147663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.161044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.161044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.161044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.161044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.161361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.161361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.220726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:53.228773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cdb97da3-611b-4d6b-a737-f49277e22d7b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1298 microversion: 2.1 time: 0.086727 Aug 24 07:56:53.232723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 284/541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:53 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:53.454575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.455790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.462097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.462573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.463003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.463774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.464118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.464529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.487908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-82092a6a-7242-402f-aec7-6ab77c0ab789 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/ips" status: 200 len: 151 microversion: 2.1 time: 0.037150 Aug 24 07:56:53.488581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 258/542] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:56:53 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:53.971575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.972155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.979378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.979864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.980298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.981047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.981585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.982009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.078035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'services' on Instance uuid 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:56:54.250481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:54.251116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:54.257580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.258058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.258489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.259169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.259621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.260042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.390329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5280cdf0-8952-41d2-87ea-89b253412440 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments/2aa120b3-1777-4acb-921c-5f489808cb89" status: 202 len: 0 microversion: 2.1 time: 0.423552 Aug 24 07:56:54.390991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 285/543] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:56:53 2022] DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments/2aa120b3-1777-4acb-921c-5f489808cb89 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:56:54.395039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:54.400494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:54.402927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:54.403064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-24272845-9ea2-4368-889b-6f8b0e292039 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.156475 Aug 24 07:56:54.403477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 259/544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:54 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:54.409561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.410115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.410612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.411385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.411908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.412332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.441734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff50a233-8967-4898-a34f-3af6c7c94bef tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Aug 24 07:56:54.442287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 286/545] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:54 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:55.424345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:55.424345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:55.431310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.431790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.432224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.432942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.433396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.433812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.455398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:55.457590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:55.464117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.464596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.465084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.465761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.466208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.466635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.498946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8544d2a3-6d68-4c5a-9794-987e8125ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048502 Aug 24 07:56:55.499583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 287/546] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:55 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:55.569225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:55.577296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a194f773-cd45-470f-b9d7-a40cb1ae9a1f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.157876 Aug 24 07:56:55.577877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 260/547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:55 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:56.511406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:56.513655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:56.521009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.521483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.521921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.522603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.523049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.523464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.553133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c96346b-be93-44cd-81f1-32ad861927dd tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Aug 24 07:56:56.557904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 288/548] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:56 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:56.598408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:56.599727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:56.606640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.607266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.607736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.608436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.608921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.609344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.807806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:56.816406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96b3a785-f1f6-420d-9534-cfe6ea72f9a0 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.221921 Aug 24 07:56:56.817234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 261/549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:56 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:56.989939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d25948-e2ff-41c2-81d7-c9912a94ec45", "tag": "f4fc24f2-6d76-46cc-916f-e5583fdcf10a"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:56.999844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.000314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.002191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.017287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] Creating event network-changed:f4fc24f2-6d76-46cc-916f-e5583fdcf10a for instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 on hv-cinder-85427 Aug 24 07:56:57.022398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-f134b3dc-1f9d-4463-982b-8ed446ffd07f req-f9eed562-7711-4584-b242-86bffdf1749c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 Aug 24 07:56:57.023154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 289/550] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:56:57.335272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d79f01c-cffa-402c-a2b2-68dfaaf150c6"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:57.337847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:57.344461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.345821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.346006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.346718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.347157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.347567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.363277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:57.443187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-702881085", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "networks": [{"uuid": "d9679161-d305-4d3b-b7e0-280c7b6b919f"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:57.499069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] validate_networks() for [('d9679161-d305-4d3b-b7e0-280c7b6b919f', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:56:57.859442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:56:57.860035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:56:57.860436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:56:57.861468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:56:57.861886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:56:57.871416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.871885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.872315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.873065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.873506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.873923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.890243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Getting quotas for project 05b468fa5d3046ebb37fbd43102be471. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:56:57.894130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Getting quotas for user ab1a288170374d1a80355c869c78b4ca and project 05b468fa5d3046ebb37fbd43102be471. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:56:57.904930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:56:57.907286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:56:58.078850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-376a2c8a-91e9-4c2e-a516-c09dbf53f77b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639909 Aug 24 07:56:58.085402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 290/551] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:56:58.085402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.086932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.093051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.093524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.094800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.094800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.095685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.096350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.134196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bebb8741-390e-4eba-91e2-9bf55d88760d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053130 Aug 24 07:56:58.134766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 291/552] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:56:58.139221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.139903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.146274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.146747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.147170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.147847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.148511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.148966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.167398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:58.295088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.303816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c643cae6-ee16-4eb6-b3af-1ebfb63cd45b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.168100 Aug 24 07:56:58.304380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 292/553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:58.308844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-099a382a-cae6-4b40-9068-7fcf937867f6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.309439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-099a382a-cae6-4b40-9068-7fcf937867f6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.360333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-099a382a-cae6-4b40-9068-7fcf937867f6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.367799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-099a382a-cae6-4b40-9068-7fcf937867f6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1218 microversion: 2.1 time: 0.062424 Aug 24 07:56:58.368551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 293/554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:58.373083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.373546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.379954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2d07a90d-b2d7-4222-8457-0e9c0f5c8d66 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049186 Aug 24 07:56:58.381568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 262/555] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:56:57 2022] POST /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 194 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:58.381877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.382409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.382846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.383550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.384005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.384450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.414568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:56:58.762364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5bafd443-8ab8-424b-8aa4-2b0bfbc24ac5 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 204 len: 0 microversion: 2.1 time: 0.392668 Aug 24 07:56:58.762959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 294/556] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:56:58 2022] DELETE /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:56:58.772277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.773006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.779195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.779671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.787101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.787101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.787101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.787101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.919185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.927116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0a7ab265-7bc9-4374-bc69-80b5d7b93539 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1686 microversion: 2.1 time: 0.159521 Aug 24 07:56:58.927686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 263/557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:59.326420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.327131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.333249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.333768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.334209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.334986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.335470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.335976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.390646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.391402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.397675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.398232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.398846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.399809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.400318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.400765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.462854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:59.468168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:59.472594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf34f09c-3bd8-4449-ad4e-6039dce0d2cc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1222 microversion: 2.1 time: 0.085791 Aug 24 07:56:59.476812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03068cf3-5ad6-4800-a84c-8a29178e7163 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.154982 Aug 24 07:56:59.477382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 295/558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:59.486647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 264/559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:59.949748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.950354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.956864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.957361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.957772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.958454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.958895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.959311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.094315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.102499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8884bb27-ecf4-404a-88bf-688b8262fcb8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1686 microversion: 2.1 time: 0.156875 Aug 24 07:57:00.103076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 296/560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:00.494278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:00.494875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:00.497205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:00.497803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:00.501227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.502008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.502479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.503156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.503593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.504002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.504141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.504679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.505114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.505802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.506393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.506871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.569690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.577524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-02d61b0c-2c25-4c36-9cff-09bca7a4cdf8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1222 microversion: 2.1 time: 0.087271 Aug 24 07:57:00.578158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 265/561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:00.644937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.652475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-50e718af-93cb-4dc5-b38c-711b686c2c09 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.158968 Aug 24 07:57:00.653055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 297/562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:00 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:01.124089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.124711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.128568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:01.129272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:01.132802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.133279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.133708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.134394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.134841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.135255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.264513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:01.272240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5f05e9ef-cfe9-4d42-ae0a-b881b71630c4 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1686 microversion: 2.1 time: 0.152189 Aug 24 07:57:01.272880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 266/563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:01.598874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.599581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.606182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.606665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.607093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.607773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.608213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.608625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.669113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:01.674088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.674733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.677774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c4a7242d-2bac-4e1b-b022-e9cc30708122 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1222 microversion: 2.1 time: 0.083307 Aug 24 07:57:01.678339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 298/564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:01.681009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.681484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.681909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.682593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.683036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.683460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.811377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:01.819068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a5da4fe2-f6c9-444b-bb16-80ec01dd6c61 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.149428 Aug 24 07:57:01.819636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 267/565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:02.293496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:02.294422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:02.301721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.302476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.302907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.303762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.304377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.304826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.459971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:02.469301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83ea6443-f8d8-44bc-a006-494403302924 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1686 microversion: 2.1 time: 0.179669 Aug 24 07:57:02.472132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 299/566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:02 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:02.699179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:02.700537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:02.708054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.708696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.709130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.709830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.710277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.710685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.841162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:02.842488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:02.850579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.851061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.851487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.852184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.852626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.853064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.909399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:02.917777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-57de0ed7-a45a-4f31-96d1-f2f23bae3df3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1270 microversion: 2.1 time: 0.222987 Aug 24 07:57:02.918665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 268/567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:02 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:02.991367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:02.999195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e5337869-6329-4bb4-aa6c-62f4ede56e06 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.161961 Aug 24 07:57:02.999763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 300/568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:02 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:03.495073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb", "name": "network-vif-deleted", "tag": "241243ae-1050-44e2-a24e-b448ad548ecf"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:03.506857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.507315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.507749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.511403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:03.512276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:03.518959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.519705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.520261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] Creating event network-vif-deleted:241243ae-1050-44e2-a24e-b448ad548ecf for instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb on hv-cinder-85427 Aug 24 07:57:03.520597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.522524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.523188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.523934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.526617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-9bd7426c-5abf-4347-bd8a-6b8c47240a5e req-ef14f946-c4f4-469b-bc3d-544dacb590fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 Aug 24 07:57:03.527805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 269/569] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:03.615026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:03.628540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d59667e7-f16f-4d84-86eb-e12c01a38451 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1620 microversion: 2.1 time: 0.120692 Aug 24 07:57:03.643819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 301/570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:03 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1620 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:03.945568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:03.945568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:03.953201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.954037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.955676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.956765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.957454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.958081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.027016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:04.029505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:04.051610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:04.058588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.071183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.071183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.071183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.071183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.071763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.114967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.123794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-81a11d01-76b3-46dd-8918-338b151c157c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.186160 Aug 24 07:57:04.124836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 270/571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:04.238677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.246358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6c1e3a73-ffa8-401a-b3d1-329b6aeddb3c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.230572 Aug 24 07:57:04.259955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 302/572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:04 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:04.381672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d25948-e2ff-41c2-81d7-c9912a94ec45", "name": "network-vif-plugged", "status": "completed", "tag": "f4fc24f2-6d76-46cc-916f-e5583fdcf10a"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:04.392431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.397321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.397856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.411206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] Creating event network-vif-plugged:f4fc24f2-6d76-46cc-916f-e5583fdcf10a for instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 on hv-cinder-85427 Aug 24 07:57:04.416222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-44139132-89d2-412d-8e2f-beb47325706e req-b6d9610a-5e6c-4fef-9c9d-6f3a3eb22231 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040354 Aug 24 07:57:04.416841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 271/573] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:04.651950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:04.652766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:04.659482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.660199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.660979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.661989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.662603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.663188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.704828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.704828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.704828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.705205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'fault' on Instance uuid 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:04.753323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.761516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c12971a2-5f5b-43e2-9fbf-64634d741b84 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 200 len: 1334 microversion: 2.1 time: 0.114179 Aug 24 07:57:04.767430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 303/574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:04 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 1334 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:05.151801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810c41f4-f7ab-43b6-bbdb-81d52de49f0d", "tag": "8ceae910-04d6-4271-b981-57b6f62898ca"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:05.162915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.163730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:05.170879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.171348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.175375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.175840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.176257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.180276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.181281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.181752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.182169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.194868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] Creating event network-changed:8ceae910-04d6-4271-b981-57b6f62898ca for instance 810c41f4-f7ab-43b6-bbdb-81d52de49f0d on hv-cinder-85427 Aug 24 07:57:05.199914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-59ecda99-d2db-42b2-b76a-fadbd8c3b638 req-43f1f114-2dd6-4036-856a-b574613508a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054492 Aug 24 07:57:05.200873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 272/575] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:05.269424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.270191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:05.276420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.276922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.277592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.278269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.278713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.279152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.319357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:05.327727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef325896-7c10-4564-b2d6-e95b3a432f52 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.183536 Aug 24 07:57:05.328340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 304/576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:05.411656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:05.418740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0e463b51-571d-42bd-ae34-d4da9af5ab6b tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1364 microversion: 2.1 time: 0.154657 Aug 24 07:57:05.419314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 273/577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:05 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:05.841289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.841892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:05.849068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.849935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.849935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.850605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.851059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.851454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.865352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] HTTP exception thrown: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Request method failure captured: Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb HTTP/1.1 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdikBRAn27k9M6f2KCiv1ag_86tIj8pmXaeEkPajvJ6pZgX4fEXkW6EPiFc7s23Bi0290etk-9ELd2V9lkOYCUy-9uRgXS-9oJ9GUCcLUH9KUWo6dXnDNqfM0OTMxbn6kpJ6V2KMvwI7FqrKVxoJLGbG2gylyqpFChvTkXnJ7rQ3B34 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:57:05.866987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}] Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: e23edadcfe3d4a0b81b13e278682ca2f Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. Aug 24 07:57:05.868602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb'} Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:05.873040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. Aug 24 07:57:05.874570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:05.876071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Returning 404 to user: Instance 0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:05.876071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d1e389a-c4db-4cb6-ad4d-f112373df217 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb" status: 404 len: 111 microversion: 2.1 time: 0.086626 Aug 24 07:57:05.876071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 305/578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:05 2022] GET /compute/v2.1/servers/0cc09fcb-4ac9-4f85-a709-4ad1a16ef9cb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:05.880028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e228e3f-7a73-4d84-88da-7e575e0f1460 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '.version_select at 0x7f4562e56670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.963012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e228e3f-7a73-4d84-88da-7e575e0f1460 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074935891" status: 202 len: 0 microversion: 2.1 time: 0.088742 Aug 24 07:57:05.963668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 274/579] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Aug 24 07:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074935891 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:57:06.348327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:06.348948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:06.355419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.355910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.356367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.357066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.361928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.361928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.440310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:06.440956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:06.447676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.448227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.449137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.449834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.450289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.450710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.494693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:06.503503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03b4f9bd-611e-484b-bb2b-d80fa4c7324e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.159224 Aug 24 07:57:06.504282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 306/580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:06.639654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:06.647382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1cfb240e-4d6f-4659-958b-567e0d8bd502 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1551 microversion: 2.1 time: 0.211720 Aug 24 07:57:06.647952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 275/581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:06 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:06.667862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:06.668349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:06.674825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.676970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.676970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.676970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.676970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.677347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.756912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b5677c8f-1744-4976-a792-10b7869b98fe tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092858 Aug 24 07:57:06.757616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 307/582] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:57:06 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:07.524290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:07.525127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:07.533685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.533842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.534351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.535049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.535500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.535979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.723952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:07.733021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bb1055ac-d2c4-419f-a821-65cd340192ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.212570 Aug 24 07:57:07.733758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 276/583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:08.112051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d25948-e2ff-41c2-81d7-c9912a94ec45", "tag": "f4fc24f2-6d76-46cc-916f-e5583fdcf10a"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:08.117559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:08.122840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.123303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.123729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.137263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] Creating event network-changed:f4fc24f2-6d76-46cc-916f-e5583fdcf10a for instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 on hv-cinder-85427 Aug 24 07:57:08.142684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-95aa7eca-c17f-4444-bc21-7cd116205b38 req-68bab384-552d-418c-a0f9-e0df7a629332 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035133 Aug 24 07:57:08.143276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 308/584] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:08.772197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:08.772849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:08.779277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.779748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.787530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.787530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.787530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.787530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.918173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:08.926088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a0041ef2-4863-4e5f-97fb-f328cc54f92d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.158093 Aug 24 07:57:08.926677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 277/585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:09.385593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.386205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.388090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=14 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:09.394717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.395194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.395622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.396313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.396880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.402703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.423359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:09.426317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:09.825023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ddb2a65-4cc7-4425-bb9c-8b540a761f45 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 204 len: 0 microversion: 2.1 time: 0.444256 Aug 24 07:57:09.829141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 309/586] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:09 2022] DELETE /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:57:09.833857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.834573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.836993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:09.841761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.842241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.842674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.843380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.843829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.844250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.947255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.948075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.955395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.955876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.956316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.957031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.957482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.957899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.982492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:09.991148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-598ae17e-bee6-41a0-ac5b-f690f0341520 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1509 microversion: 2.1 time: 0.161213 Aug 24 07:57:09.991720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 278/587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:10.089586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:10.097642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-179a1866-91a4-4e2c-b9d1-488d33d78954 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.154654 Aug 24 07:57:10.098243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 310/588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:10.219174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d79f01c-cffa-402c-a2b2-68dfaaf150c6"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:10.221876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:10.228053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.228518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.228966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.229647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.230089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.230535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.318074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: POST /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments HTTP/1.1 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 74 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:57:10.319840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {"volumeAttachment": {"volumeId": "1d79f01c-cffa-402c-a2b2-68dfaaf150c6"}} Aug 24 07:57:10.321331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'server_id': '77aa9852-e8b2-470f-aeb4-e4e442384feb', 'body': {'volumeAttachment': {'volumeId': '1d79f01c-cffa-402c-a2b2-68dfaaf150c6'}}} Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:10.322077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:10.324194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 400 to user: Invalid volume: volume 1d79f01c-cffa-402c-a2b2-68dfaaf150c6 is already attached to instances: 77aa9852-e8b2-470f-aeb4-e4e442384feb {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1c978828-f630-4bb1-a59e-85b9bd279a88 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106571 Aug 24 07:57:10.326042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 279/589] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:57:10 2022] POST /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:57:10.393670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:10.394250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:10.400936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.402440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.402440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.402640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.402926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.403345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.488613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lazy-loading 'services' on Instance uuid 77aa9852-e8b2-470f-aeb4-e4e442384feb {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:10.709854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-865da380-985a-415e-9a4a-f3900f266ba6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments/1d79f01c-cffa-402c-a2b2-68dfaaf150c6" status: 202 len: 0 microversion: 2.1 time: 0.320742 Aug 24 07:57:10.710492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 311/590] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 07:57:10 2022] DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments/1d79f01c-cffa-402c-a2b2-68dfaaf150c6 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:57:10.719033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:10.721974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:10.728117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.728582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.729053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.729725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.730161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.730695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.756569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:10.761432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6debb912-4c07-4c8c-a7d0-5ddfce6bf663 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Aug 24 07:57:10.761995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 280/591] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:57:10 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:11.012522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:11.013220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:11.020035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.020513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.020997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.021675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.022119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.022536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.118699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:11.119301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:11.127122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.127619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.128040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.128754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.129196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.129605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.156625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:11.166136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-140d7a1f-811c-4511-9f5a-a55b0118f17d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1509 microversion: 2.1 time: 0.157725 Aug 24 07:57:11.166810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 312/592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:11 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:11.258107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:11.265717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bc87dc18-c03e-4b84-8561-4582fdd1a412 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.150717 Aug 24 07:57:11.266744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 281/593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:11.773691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:11.775948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:11.782826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.783371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.783738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.784420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.784900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.785323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.817085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-90c38c04-9f55-44dd-8d14-27e76b0840f9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047393 Aug 24 07:57:11.817635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 313/594] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:57:11 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:12.187294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:12.187954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.195487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.195970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.196404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.197178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.197668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.198091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.287680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:12.288614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.294649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.295191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.295684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.299719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.307533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.308130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.330940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:12.338629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7207ad77-07d3-4a9d-8152-6ab97a72fde3 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1509 microversion: 2.1 time: 0.155183 Aug 24 07:57:12.340678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 282/595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:12 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:12.397127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810c41f4-f7ab-43b6-bbdb-81d52de49f0d", "name": "network-vif-plugged", "status": "completed", "tag": "8ceae910-04d6-4271-b981-57b6f62898ca"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:12.405224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.405698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.406120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.418359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] Creating event network-vif-plugged:8ceae910-04d6-4271-b981-57b6f62898ca for instance 810c41f4-f7ab-43b6-bbdb-81d52de49f0d on hv-cinder-85427 Aug 24 07:57:12.424160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-2be0c05c-c893-4e40-b3de-f49faa1fec18 req-bbbf5c62-c1f1-45a6-9c26-d0c84dfab2d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Aug 24 07:57:12.424782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 283/596] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:12.447063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:12.455177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7f5cee6d-5041-4103-b822-17b33a47d645 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.171357 Aug 24 07:57:12.455761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 314/597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:12.830499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:12.832960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.839634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.840213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.840743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.841504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.842086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.842692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.889797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8f9aadf2-963b-403b-9af0-89c571f405d1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063920 Aug 24 07:57:12.894866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 284/598] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:57:12 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:13.205630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccfb722-36b1-441e-b4e9-c6941f34ebf9", "name": "network-vif-deleted", "tag": "c620ae12-868a-4af5-866e-99f16d6967e0"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:13.214750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.215215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.215631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.227753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] Creating event network-vif-deleted:c620ae12-868a-4af5-866e-99f16d6967e0 for instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 on hv-cinder-85427 Aug 24 07:57:13.233640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-d3c0f856-0c0c-430d-8a41-9406f3015782 req-6e977bfd-6998-4468-a356-d05e5fc6a765 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031398 Aug 24 07:57:13.233640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 315/599] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:13.360273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:13.361057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.368032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.374527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.374527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.374527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.374527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.374923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.435961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:13.443763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a44d1641-5563-42c9-9a08-6560cad39c42 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1293 microversion: 2.1 time: 0.087506 Aug 24 07:57:13.444271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 285/600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:13 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:13.477209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:13.477704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.484143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.484622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.485167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.485925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.486371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.486789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.634853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:13.643882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e01ef1a0-9342-41d1-b187-201a052b584c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.171098 Aug 24 07:57:13.644457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 316/601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:13.894148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:13.894676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.901070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.901546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.902043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.902756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.902925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:13.903204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.903621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.905157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.911172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.911646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.912075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.912802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.913247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.913662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.929052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lazy-loading 'flavor' on Instance uuid 0ac1cc68-c627-403b-b458-375093efed24 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:13.947263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3fcdee21-2494-423d-901e-eb9ec026e840 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048255 Aug 24 07:57:13.948543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 317/602] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 07:57:13 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 07:57:14.014804 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.015344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.022204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.022713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.023131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.023799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.024240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.024676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.050232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:14.286814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-34d5483c-d9fa-462b-b8d8-b8ee3d5af3cf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "POST /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24/action" status: 202 len: 0 microversion: 2.1 time: 0.396946 Aug 24 07:57:14.287398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 286/603] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 07:57:13 2022] POST /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:57:14.295775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.296456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.302768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.303238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.303645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.304313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.304804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.305218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.333334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6d85431-da69-46e4-b39a-e1d83f40053e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 204 len: 0 microversion: 2.1 time: 0.322078 Aug 24 07:57:14.334109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 318/604] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:14 2022] DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:57:14.342469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.343150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.350221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.350681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.351105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.351786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.352229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.352638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.442835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.451350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec19c898-6d93-41e2-a3bc-b312d15133f7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.159444 Aug 24 07:57:14.452015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 287/605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:14.466840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.468310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.478188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.479162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.479162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.479838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.480283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.480729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.496327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.505331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e9effb13-ec22-4a24-b6c3-3f5bee0c23f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1682 microversion: 2.1 time: 0.166913 Aug 24 07:57:14.506010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 319/606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:14.519090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.519562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.519985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.520589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'fault' on Instance uuid 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:14.560551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.568846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-21c3e48b-d6f9-4fa5-968c-84c24157c4d0 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1312 microversion: 2.1 time: 0.107176 Aug 24 07:57:14.569404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 288/607] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:14.664927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.665546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.671545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.672016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.672586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.673446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.673885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.674301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.803579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.811263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3989eb0a-87b2-4644-9f9f-68fd60a9ecf5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1318 microversion: 2.1 time: 0.150269 Aug 24 07:57:14.811829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 320/608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:15.473344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.473927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.480351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.480865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.481300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.481981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.482459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.482879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.526734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.527403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.534759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.717268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.717268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.717268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.717268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.718276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.718473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.718473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-53e0e95f-eafe-43ff-adfb-d8958197781d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.170925 Aug 24 07:57:15.718473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 289/609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:15.718473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.718894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.718894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.718894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.718894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.720034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.720034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.720034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.720276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.720393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.720393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.720393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.720393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'fault' on Instance uuid 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:15.720763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0275cd52-9029-4f8e-a26f-8ba95d23562d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1682 microversion: 2.1 time: 0.169393 Aug 24 07:57:15.720763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 321/610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:15.727925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.735688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-91be9d66-958d-44b1-91de-8320a3dda669 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 200 len: 1312 microversion: 2.1 time: 0.094443 Aug 24 07:57:15.740481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 290/611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:15.833655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.834265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.840228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.843612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.843612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.843612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.843612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.843983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.970504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.978429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-34e71dde-4451-467a-b279-fd9fd47140cf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1508 microversion: 2.1 time: 0.148740 Aug 24 07:57:15.978932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 322/612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:15.999083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75f8d53c-d72e-4a92-a270-4910c26a39c2", "device": "/dev/sdb"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:16.002137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.008151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.008622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.009085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.009762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.010207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.010622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.662706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.663449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.669911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.670384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.670806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.671484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.671926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.672431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.678019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:16.813674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:16.821824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-71ff4093-c319-4eee-873b-e5152d0ab65a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.162943 Aug 24 07:57:16.822397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 323/613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:16.827038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.827670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.834148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.834862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.835293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.835972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.836412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.836852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.968546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:16.976928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f1f36dfc-fb1f-4520-875c-075af171ff43 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1682 microversion: 2.1 time: 0.153561 Aug 24 07:57:16.977499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 324/614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:16.981961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.982558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 3ccfb722-36b1-441e-b4e9-c6941f34ebf9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.989970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.990451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.990936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.991582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.992032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.992453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.006154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] HTTP exception thrown: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Request method failure captured: Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 HTTP/1.1 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdikBRAn27k9M6f2KCiv1ag_86tIj8pmXaeEkPajvJ6pZgX4fEXkW6EPiFc7s23Bi0290etk-9ELd2V9lkOYCUy-9uRgXS-9oJ9GUCcLUH9KUWo6dXnDNqfM0OTMxbn6kpJ6V2KMvwI7FqrKVxoJLGbG2gylyqpFChvTkXnJ7rQ3B34 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:57:17.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}] Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: e23edadcfe3d4a0b81b13e278682ca2f Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. Aug 24 07:57:17.009473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '3ccfb722-36b1-441e-b4e9-c6941f34ebf9'} Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:17.010383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. Aug 24 07:57:17.011853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:17.013302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Returning 404 to user: Instance 3ccfb722-36b1-441e-b4e9-c6941f34ebf9 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:17.013302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83a5b4b8-550a-47f6-b965-bbed4385f2ec tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9" status: 404 len: 111 microversion: 2.1 time: 0.030801 Aug 24 07:57:17.013302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 325/615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/3ccfb722-36b1-441e-b4e9-c6941f34ebf9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:17.018207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:17.018693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:17.024808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.025284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.026937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.026937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.026937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.027258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.056437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:17.108767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2e2702cf-d768-4ae5-a3a8-d891d962a59a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "POST /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.086044 Aug 24 07:57:17.108767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 291/616] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 07:57:15 2022] POST /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments => generated 194 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:17.427291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-09c86eb4-86ba-405e-9c15-08e603056a63 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 204 len: 0 microversion: 2.1 time: 0.412763 Aug 24 07:57:17.428682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 326/617] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:17 2022] DELETE /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:57:17.438598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:17.439584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:17.447340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.447921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.448358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.449371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.449815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.450236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.650011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:17.662151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa9852-e8b2-470f-aeb4-e4e442384feb", "name": "network-vif-deleted", "tag": "a0b691d2-8c21-4e34-9215-d5f0daade5a7"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:17.671124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8a0e1277-b2ef-4aa1-ac11-b36447e3ac61 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.238011 Aug 24 07:57:17.671708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 292/618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:17 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:17.683039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.683578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.684024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.696454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] Creating event network-vif-deleted:a0b691d2-8c21-4e34-9215-d5f0daade5a7 for instance 77aa9852-e8b2-470f-aeb4-e4e442384feb on hv-cinder-85427 Aug 24 07:57:17.701753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-a5254ba6-f8bb-42ce-8a50-0fb9f6422f8f req-b74d9921-e72d-48db-ba08-d696f419fea3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043697 Aug 24 07:57:17.702540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 327/619] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:17.844104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:17.844813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:17.850987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.851457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.851875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.852555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.853022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.853438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.991247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:17.999637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e180f174-7692-4f6e-bb80-77810056a4cd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.159928 Aug 24 07:57:17.999997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:18.000217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 293/620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:18.001269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:18.007823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.008376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.008915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.009838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.010427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.011083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.075807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:18.084528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c014de00-e83d-4d60-9abc-73b0511727ca tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1614 microversion: 2.1 time: 0.088738 Aug 24 07:57:18.085136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 328/621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:17 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:18.692938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:18.693498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:18.700410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.700944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.701439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.702152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.702600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.703022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.705790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:18.838245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:18.846595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e92f8105-a127-4b32-9c54-4be6c1cea157 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.158456 Aug 24 07:57:18.847160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 294/622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:18 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:19.021148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.021688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.027985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.028462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.028933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.029609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.030055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.030472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.106161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.106770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.114306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.114783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.115209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.115890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.116333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.116775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.165584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:19.174032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fcbabc58-4a4d-4e27-a893-14451aa774fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156780 Aug 24 07:57:19.174612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 329/623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:19.178348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:19.186146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d68d0cdb-4bd3-4809-b431-dfec46b947d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1614 microversion: 2.1 time: 0.083839 Aug 24 07:57:19.186704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 295/624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:19.866749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.867341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.873633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.874114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.874548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.875938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.876264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.876948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.005122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:20.012818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-018d0d51-b7dd-4989-9498-9998767bf98d tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.149958 Aug 24 07:57:20.013376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 330/625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:20.195012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:20.195613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:20.202408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.203049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.203671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.204354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.204831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.205246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.207120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:20.207725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:20.213936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.214530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.215030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.215804 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.216322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.216841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.279307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:20.287180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-410ae346-b642-460e-9ca2-5b704e769143 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1614 microversion: 2.1 time: 0.083831 Aug 24 07:57:20.287765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 331/626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:20 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:20.339117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:20.347539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3276c70e-f094-45c8-b273-af813efdbd99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156324 Aug 24 07:57:20.348101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 296/627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:21.034620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:21.035223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:21.041919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.042432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.042869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.043563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.044014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.044434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.179330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.187204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a6620de3-4d6b-4140-ad4a-0745adb6f342 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1522 microversion: 2.1 time: 0.157157 Aug 24 07:57:21.188383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 332/628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:21 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:21.308895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:21.309542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:21.316624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.317154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.317589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.318280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.318734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.319179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.351845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.352322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.352777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.353245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lazy-loading 'fault' on Instance uuid 77aa9852-e8b2-470f-aeb4-e4e442384feb {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:21.371402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:21.372561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:21.379690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.380166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.380768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.381494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.382020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.382467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.405781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.413771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5d2a4e45-50a1-410b-a216-5551abd4a2a7 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 200 len: 1330 microversion: 2.1 time: 0.108884 Aug 24 07:57:21.414447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 297/629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:21 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:21.536893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.549103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bba4930d-6a4b-4ddc-9787-8fb8bc8b6a9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.180121 Aug 24 07:57:21.549531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 333/630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:21.649772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87322eac-6f5b-4382-afab-9c669bb6b2f3", "name": "network-vif-deleted", "tag": "60a4ccac-1e7f-44bd-88de-423dd82953fd"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:21.659167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.659634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.660050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.673999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] Creating event network-vif-deleted:60a4ccac-1e7f-44bd-88de-423dd82953fd for instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 on hv-cinder-85427 Aug 24 07:57:21.679198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-a9d48ac9-18a9-4efe-aa38-8fd5d4354d03 req-d2dfe0f7-bac3-43ff-8599-4c196adaeac2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093956 Aug 24 07:57:21.679975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 298/631] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:22.209252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.210088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.216416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.216917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.217340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.218010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.218479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.218889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.253637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.254105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.254524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.254954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lazy-loading 'fault' on Instance uuid 87322eac-6f5b-4382-afab-9c669bb6b2f3 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:22.294887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23edadcfe3d4a0b81b13e278682ca2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75ba813beae4999b9ae2afd58de8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:22.302720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d31bd19-47ca-4f65-89ca-22804a9ccd58 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 200 len: 1311 microversion: 2.1 time: 0.097412 Aug 24 07:57:22.303270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 334/632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:22.440716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.441404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.447524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.447992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.448410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.449394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.449831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.450241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.463857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb HTTP/1.1 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 07:57:22.465398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 07:57:22.466898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '77aa9852-e8b2-470f-aeb4-e4e442384feb'} Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:22.467699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 07:57:22.468874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 07:57:22.470497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:22.470497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5bbd8054-e248-4194-a5bb-7b884566fd42 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 404 len: 111 microversion: 2.1 time: 0.031281 Aug 24 07:57:22.470497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 299/633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:22.476474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-905b3ced-722b-47f2-bc63-820fd4bf4fbf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '.version_select at 0x7f4562ce3ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.569796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.570425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.572402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-905b3ced-722b-47f2-bc63-820fd4bf4fbf tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800774132" status: 202 len: 0 microversion: 2.1 time: 0.099678 Aug 24 07:57:22.573773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 335/634] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 24 07:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800774132 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:57:22.576779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.577262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.577938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.578912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.579555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.579978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.776301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:22.784365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b733fb6b-f090-4186-a92c-9278e15fcba1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.218410 Aug 24 07:57:22.785335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 300/635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:23.324048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:23.324589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] [instance: 87322eac-6f5b-4382-afab-9c669bb6b2f3] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:23.331380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.331860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.332296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.333239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.333695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.334205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] HTTP exception thrown: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Request method failure captured: Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 HTTP/1.1 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdikBRAn27k9M6f2KCiv1ag_86tIj8pmXaeEkPajvJ6pZgX4fEXkW6EPiFc7s23Bi0290etk-9ELd2V9lkOYCUy-9uRgXS-9oJ9GUCcLUH9KUWo6dXnDNqfM0OTMxbn6kpJ6V2KMvwI7FqrKVxoJLGbG2gylyqpFChvTkXnJ7rQ3B34 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 07:57:23.350763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a75ba813beae4999b9ae2afd58de8d25"}]}] Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: a75ba813beae4999b9ae2afd58de8d25 Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375242047 Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: e23edadcfe3d4a0b81b13e278682ca2f Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375242047-project Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. Aug 24 07:57:23.352124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '87322eac-6f5b-4382-afab-9c669bb6b2f3'} Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:23.352916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. Aug 24 07:57:23.354090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 07:57:23.355195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] Returning 404 to user: Instance 87322eac-6f5b-4382-afab-9c669bb6b2f3 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:23.355195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4caf4b6-cad5-44d8-9fbb-acdfd2a537e8 tempest-ServerRescueNegativeTestJSON-375242047 tempest-ServerRescueNegativeTestJSON-375242047-project] 10.222.0.26 "GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3" status: 404 len: 111 microversion: 2.1 time: 0.032370 Aug 24 07:57:23.356578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 336/636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:23 2022] GET /compute/v2.1/servers/87322eac-6f5b-4382-afab-9c669bb6b2f3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:23.463703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-07722eac-4bf7-426d-a0a7-1aed033afc9b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: .version_select at 0x7f4562e47670>, body: {"keypair": {"name": "tempest-keypair-1724849615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFULJmWQcdOdxGrSUZu338DDMjwskdq2mS2ewsD75mrOzNaFKIOs41I3KUZzB9ALPo4wSrFZoCelNE2iMwUjMbOtbvNXmUwAmAToHXTuSqxGtC5zBLGhGoPwDLWlle8wA=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:23.481222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-07722eac-4bf7-426d-a0a7-1aed033afc9b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:23.485476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-07722eac-4bf7-426d-a0a7-1aed033afc9b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:23.568847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-07722eac-4bf7-426d-a0a7-1aed033afc9b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110159 Aug 24 07:57:23.569573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 301/637] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 07:57:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:23.805963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:23.806600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:23.812513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.813115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.813549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.814237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.814684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.815194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.954476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:23.962672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df1f2597-636f-4af4-8542-adddc0a86531 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.160592 Aug 24 07:57:23.963602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 337/638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:24.546594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.548634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.554944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.555428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.555860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.556557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.569061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.569604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.609110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:24.939825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-31c4ac1b-cfce-4da4-a8af-da51b876cb73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "DELETE /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 204 len: 0 microversion: 2.1 time: 0.397754 Aug 24 07:57:24.940423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 302/639] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:24 2022] DELETE /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:57:24.949067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.949680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.956956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.957465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.958103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.958797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.959249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.959860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.985493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.986196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.995336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.996498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.996966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.997663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.998115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.998534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.111688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:25.119890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-50277e9b-3e27-480c-b8fa-a8fa8ffb82c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1577 microversion: 2.1 time: 0.175030 Aug 24 07:57:25.120679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 338/640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:25.509646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:25.519694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-effd9fbb-140f-41ab-a50f-ba20d8a763ea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.538322 Aug 24 07:57:25.520521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 303/641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:26.142740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:26.143422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:26.150013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.150584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.151770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.152589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.153619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.154986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.393013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:26.402902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e651b82c-05be-472a-835e-d44d37165165 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1577 microversion: 2.1 time: 0.264254 Aug 24 07:57:26.407501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 339/642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1577 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:26.505733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480846656", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25fc9eb1-bc13-4133-b4c8-3baba837afc7"}], "security_groups": [{"name": "tempest-securitygroup--1830131798"}], "key_name": "tempest-keypair-1724849615", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:26.542093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:26.545841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:26.559071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:26.564022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.566867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.567622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.568673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.569748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.574327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.711567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] validate_networks() for [('25fc9eb1-bc13-4133-b4c8-3baba837afc7', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:57:26.729501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:26.733275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:26.738581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ce0addc-c0c8-435b-8fd9-cdf0b696f3c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.200470 Aug 24 07:57:26.739109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 340/643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:27.429222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:27.429932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.438821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.439683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.440402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.441252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.441846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.442359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.790875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:27.803732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dccfe8ea-2f0a-4646-9596-67d993600d88 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1577 microversion: 2.1 time: 0.377672 Aug 24 07:57:27.816668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:57:27.816668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:57:27.816668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:57:27.816668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:57:27.816668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:57:27.823703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 341/644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1577 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:27.830170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.830692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.833355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.833355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.833733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.834183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.846097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:27.847007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.891782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:27.903385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.905203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.905410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Getting quotas for user aee01beeba5b48c3b6c25489743de40e and project ee7ef4f035fd402fb7e21a21c40e7c49. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:27.906076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.911705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.912204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.912738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.929315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:57:27.934116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:57:28.179757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.198142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-484a70d4-5eef-43cf-b1b5-24503c7ceaa7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.370800 Aug 24 07:57:28.200856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 342/645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:28.218932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-12fdc306-2936-4c2b-b99f-ebd7d946a9df tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.719006 Aug 24 07:57:28.226946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 304/646] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 07:57:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:57:28.231349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84bb6a92-8c42-4d42-981b-1260cc1d9507 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:28.235764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84bb6a92-8c42-4d42-981b-1260cc1d9507 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.326118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84bb6a92-8c42-4d42-981b-1260cc1d9507 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.340326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84bb6a92-8c42-4d42-981b-1260cc1d9507 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1241 microversion: 2.1 time: 0.113306 Aug 24 07:57:28.345507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 343/647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:28 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:28.832262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:28.832911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.842279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.842935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.843650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.844095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f4b36-7aa5-49d2-b619-ef9af95054de", "name": "network-vif-deleted", "tag": "a33cc678-e925-41ba-b5d0-1c627df702a4"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:28.844976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.845668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.846190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.854827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.855292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.855717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.867424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] Creating event network-vif-deleted:a33cc678-e925-41ba-b5d0-1c627df702a4 for instance 996f4b36-7aa5-49d2-b619-ef9af95054de on hv-cinder-85427 Aug 24 07:57:28.872711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c7d538b2-2c48-4c65-8da2-0e05b9f042bb req-ebca616d-ae00-4b28-aa89-bb5d267117d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Aug 24 07:57:28.877044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 344/648] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:57:28.934258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.938831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-48d3e977-0b15-4251-8a25-c4d9ad7d9308 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1509 microversion: 2.1 time: 0.112429 Aug 24 07:57:28.939891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 305/649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1509 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:29.224109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.225294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.232338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.232856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.233306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.234201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.234701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.235314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.366522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6126c2c-2567-472d-9ba4-e1609678728f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.367459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e6126c2c-2567-472d-9ba4-e1609678728f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.410163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.419622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df0b4bfa-78a9-4786-9732-61c0de2a4f9c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.200274 Aug 24 07:57:29.420215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 345/650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:29.507249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e6126c2c-2567-472d-9ba4-e1609678728f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.514420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6126c2c-2567-472d-9ba4-e1609678728f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1241 microversion: 2.1 time: 0.154723 Aug 24 07:57:29.515236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 306/651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:29.961142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.961756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.969982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.970791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.971234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.971921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.972367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.972818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.049621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.057911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-45117df9-875d-4cf9-83db-d91ed46041f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.100609 Aug 24 07:57:30.058619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 346/652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:30.441578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.442185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.448866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.449340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.449766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.450469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.450912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.451323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.536606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.537285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.543807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.544282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.544743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.545443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.545937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.546350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.597425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.608683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9e512f3b-b6f9-406b-8042-0fd0d109fac5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.171390 Aug 24 07:57:30.610066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 307/653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:30.618885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.627186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58d91aaa-3f96-4db6-8493-3236453b6612 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.095764 Aug 24 07:57:30.627787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 347/654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:31.079706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.080313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.082264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:31.086937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.087420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.088322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.088521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.088998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.089416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.155771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.163928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d745522d-121e-4341-9a79-1d2609ddafe1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088670 Aug 24 07:57:31.164480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 308/655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:31.632053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.632679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.639218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.639700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.641491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.641491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.641954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.642400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.648202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.649530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.656292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.657185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.657683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.658607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.659157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.659631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.723059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.730999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dc7a2060-f6a8-45a5-9339-82c6448a13f8 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.086884 Aug 24 07:57:31.731575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 309/656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:31.782399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.790283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df1700cb-f70a-4b9c-b890-d9f2c7cee50f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.162106 Aug 24 07:57:31.790848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 348/657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:32.185250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:32.185758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:32.192517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.193016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.193442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.194126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.194573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.194984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.257301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.265006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e8384395-2456-4278-867e-4a218990b421 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084020 Aug 24 07:57:32.265690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 310/658] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:32.752090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:32.752799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:32.759713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.760252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.762826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.762826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.762826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.762826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.843053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.856879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ea1b8fe-e09a-43df-8c2a-18990561d2a9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.107662 Aug 24 07:57:32.859253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 349/659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:32 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:32.877471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:32.885277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:32.892507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.893028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.893455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.894150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.894591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.895003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.051912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:33.063001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-20247c1c-0914-4644-b1dd-06b89acb00b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.189751 Aug 24 07:57:33.066336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 311/660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:33.285978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:33.286479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:33.292423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.292925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.293351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.294020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.294460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.294872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.356759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:33.365142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f11194e3-a2c5-4d67-b15a-e2cf106a33af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082990 Aug 24 07:57:33.371318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 350/661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:33.880071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:33.880846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:33.887059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.887661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.888198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.889023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.889573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.890111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.952185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:33.955684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:33.961842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-df66457e-138e-4cf7-85bf-3f84f62b48d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.085605 Aug 24 07:57:33.975499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 312/662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:33 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:34.087453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.088165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.095517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.096733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.097174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.098169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.098791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.099386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.317143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.326251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9e20ae69-e91c-4df5-b1a9-df3924ba2ac6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.242683 Aug 24 07:57:34.327069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 351/663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:34.387413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.388114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.394892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.395381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.395848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.396679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.397138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.397563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.466331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.476443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-51884a0e-7ff0-406f-9d64-bf686e931b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.093406 Aug 24 07:57:34.486999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 313/664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:34.498792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "name": "network-vif-unplugged", "status": "completed", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:34.509559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.510031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.510446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.522127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] Creating event network-vif-unplugged:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 07:57:34.527386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-056bb0d9-1414-45bb-8241-6ca899ceed8f req-2d911cea-8d39-47e4-a867-6f1f1d56f76c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036504 Aug 24 07:57:34.527989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 352/665] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:34.983763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.985866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.993460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.994034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.994528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.995278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.995959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.996843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.065967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.074931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f3de4d42-001b-4eea-a90b-f7a2bd43b0eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.095498 Aug 24 07:57:35.076673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 314/666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:34 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:35.349041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:35.351526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:35.356238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.356737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.357160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.357842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.358283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.358721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.500982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:35.502090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:35.508865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.512038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.512038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.512038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.512038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.512473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.596254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.597410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.608347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3fcf5fde-3f81-4439-80c4-af85df1e5ffa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.264453 Aug 24 07:57:35.612471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 353/667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:35.617657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d77433f1-69ce-4b13-89f5-6b7b25c8910f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.120088 Aug 24 07:57:35.619844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 315/668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:36.097441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.098050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.104095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.104574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.105031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.105715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.106161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.106578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.175910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.184732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e67fc8b-f4d5-4952-9f58-eb408e1b29ac tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.091629 Aug 24 07:57:36.189378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 354/669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:36.640433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.641300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.642652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.643551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.647939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.648419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.648934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.649625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.650073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.650635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.650976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.651525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.652026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.652862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.653380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.653870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.741028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.749005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d09ec827-547f-4e41-9821-2821eeaa1f53 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.112665 Aug 24 07:57:36.760684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 355/670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:36.807078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.816916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5d67075d-41c2-4729-810a-e00cd22042d7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.181861 Aug 24 07:57:36.817521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 316/671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:36.874227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fb1e747a-d4b5-4565-aac1-3a46c530372f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Action: 'create', calling method: .version_select at 0x7f4562c93d30>, body: {"keypair": {"name": "tempest-keypair-1357402231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUTXh4rcQP7xn9LkVx61qg6WxR8JnpVVTK2dPZwyUZ49zn+qpvqHy8DABEM3z8pDvScDI16Laj3T/2QK8FEiR2Qg7kLrfk8djTcxgb2+SiLGKLomlxNMS0YRmu4gCqwOQ=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:36.891119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-fb1e747a-d4b5-4565-aac1-3a46c530372f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:36.895584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-fb1e747a-d4b5-4565-aac1-3a46c530372f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for user 1858e633724d446dbbd128b317158d3f and project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:36.962885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fb1e747a-d4b5-4565-aac1-3a46c530372f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.211369 Aug 24 07:57:36.963489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 356/672] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Aug 24 07:57:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 212 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 07:57:37.205282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.206145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.212315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.212861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.213295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.213988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.214440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.214858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.284681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.294251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0fd95479-70d1-4a19-a33e-974087325feb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.092946 Aug 24 07:57:37.295066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 317/673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:37.772117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.772803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.779762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.780486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.781310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.782206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.783010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.783751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.842485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.843206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.849948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.850594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.850913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.851356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.852108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.852618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.853132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.861274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e83a9661-7d9e-45f6-8bc4-09bb93970de7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.092939 Aug 24 07:57:37.862004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 357/674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:37.878236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:38.022750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.030623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f81d2038-eb8e-4b77-82d6-0830db3c293c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.192021 Aug 24 07:57:38.031307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 318/675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:38.314921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:38.315534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:38.321547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.322023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.322454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.323410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.323847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.324302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.389360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.397769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c9236bfa-7c6d-4028-a06d-8719fc1e6b4e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.087086 Aug 24 07:57:38.398344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 358/676] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:38 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:38.881826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:38.883499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:38.890529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.891279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.891950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.892787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.893460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.894084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.963860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.971931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bdb719b4-60f9-4634-84c6-53c0c5b4dd0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.094071 Aug 24 07:57:38.972541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 319/677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:39.055324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.059395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.075573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.076567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.077056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.078031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.078703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.079060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.217078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1609754217", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4008a5-4c52-487f-81ff-7eac3538fa6d"}], "security_groups": [{"name": "tempest-securitygroup--1491532141"}], "key_name": "tempest-keypair-1357402231", "user_data": "}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:39.254259 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:39.263519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ea7ed861-b365-48fa-bd4f-73713e95c71f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.213389 Aug 24 07:57:39.264167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 359/678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:39.327974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] validate_networks() for [('eb4008a5-4c52-487f-81ff-7eac3538fa6d', None, None, None, None, None)] {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:57:39.422530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.422530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.425590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.426281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.426876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.427753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.428547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.429142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.500057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:39.504667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:39.510463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-046d30a8-79d8-43f6-a2bf-77fbba53cc6d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.096096 Aug 24 07:57:39.511123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=12 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:39.512849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 360/679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:39.757836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:57:39.758459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:57:39.759075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:57:39.759484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:57:39.759892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:57:39.770176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.774793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.774793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.774793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.774793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.775245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.791548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:39.795498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for user 1858e633724d446dbbd128b317158d3f and project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:39.809296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:57:39.811598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:57:39.982741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c5e52152-f2f7-4945-8324-5dd1d874952d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.770154 Aug 24 07:57:39.984174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 320/680] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Aug 24 07:57:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 07:57:39.993931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.994765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.996550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.998486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:40.002825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.002825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.003626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.003958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.004406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.005018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.077432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.090307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.092174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.096616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.099062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c50312b-d50c-443d-b2e5-15d912c534ea tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1282 microversion: 2.20 time: 0.102027 Aug 24 07:57:40.099688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 321/681] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:40.114967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ed61918a-5dff-45b0-97c8-8d987a335b13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.125588 Aug 24 07:57:40.116178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 361/682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:40.285127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:40.285645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:40.291648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.292123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.292550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.293341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.293783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.294196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.431768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.442139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-721c0002-262f-4fcc-bf97-78c0c1f8ee7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.161208 Aug 24 07:57:40.442715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 322/683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:40.534549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:40.535284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:40.541564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.542097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.544768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.544768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.544768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.544768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.611248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.619840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-011414d2-c460-45be-b12a-0d6c0405f350 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.088537 Aug 24 07:57:40.619840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 362/684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:40 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:41.121472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.122109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.138283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.139622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.146494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.146978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.150553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.150553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.150553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.150553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.178725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.186185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.187857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.189095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2a8c020b-5e86-44ed-900d-74f7443a83c3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1282 microversion: 2.20 time: 0.071449 Aug 24 07:57:41.189651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 323/685] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:41.216456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.224882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9db5dc1a-a623-43c7-84f3-8f1051c26d64 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090355 Aug 24 07:57:41.225588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 363/686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:41.463747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.464356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.472361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.472993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.473423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.474116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.474561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.474976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.608014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.616025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dfe59cda-5816-4bc5-88a3-ac79a2f83c14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156301 Aug 24 07:57:41.616585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 324/687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:41.639149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.639755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.646325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.646854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.647228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.647904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.648349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.648795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.708731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.716249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-334b4072-9b3b-4dbe-8e53-b500f0b52282 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.080915 Aug 24 07:57:41.716850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 364/688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:42.212315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.212973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.220079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.220545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.220992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.221665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.222103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.222513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.249604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.250245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.256930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.257511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.258039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.258790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.259307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.259790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.286441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.294581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.296056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.297846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-beebd596-9046-404d-92a8-f3ced004bb09 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.089418 Aug 24 07:57:42.298407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 325/689] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:42.321142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.329389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-07717d47-ee51-4ab1-bb46-d14e3d1aeb1f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083698 Aug 24 07:57:42.329960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 365/690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:42.638505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.639102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.645835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.646304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.646725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.647394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.647832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.648240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.736750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.737443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.743330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.743807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.744288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.744957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.745402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.745818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.779058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.787279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ba05ec7d-b4ef-4094-b7b9-4f968f439d3b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152447 Aug 24 07:57:42.787771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 326/691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:42.809971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.818688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6be58c7c-c2ac-450e-a563-c01f7f18bcf1 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.086512 Aug 24 07:57:42.819320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 366/692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:43.320433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.321057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.328833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.329314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.329742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.330455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.330924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.331338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.350546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.351186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.357529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.358010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.358444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.359361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.360051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.360487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.393820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.403813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.405383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.407070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f92edc94-e573-4918-8220-f2f9b6b74770 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.090511 Aug 24 07:57:43.407637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 327/693] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:43.424670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.432471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1723920-2cb8-427c-a43e-5a7a8273209c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085822 Aug 24 07:57:43.433096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 367/694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:43.809021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.809629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.816174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.822702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.822702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.822702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.822702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.823363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.839354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.840051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.846217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.846693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.847118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.847792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.848225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.848660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.911537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.919187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff4ef012-4e08-4541-94a4-dbc00d8aacae tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.083677 Aug 24 07:57:43.919764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 368/695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:43.956831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.964549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-578fe401-a5b7-4b9b-a286-be1feca258d6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.159400 Aug 24 07:57:43.965986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 328/696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:44.235825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.236231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.242276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.242750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.243176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.243882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.244330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.244777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.268208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-68afbf3d-64d5-42d8-8576-a0d3f4d48e7d tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45/ips" status: 200 len: 146 microversion: 2.1 time: 0.037277 Aug 24 07:57:44.268795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 369/697] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:44.429331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.429940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.436382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.436969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.437404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.438079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.438547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.438966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.453775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.461845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.461845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.461845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.461845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.462386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.463004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.463418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.506148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.514384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.515912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.517037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8f9038a7-a47d-4c23-aef6-4aaf7caac44e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.091532 Aug 24 07:57:44.517787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 329/698] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:44.531213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.536664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f93600c8-8097-4d5b-b7d4-66877a466ce0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087201 Aug 24 07:57:44.537418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 370/699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:44.939610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.940311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.946240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.946719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.947168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.947857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.948564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.949072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.985985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.986690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.992855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.995993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.995993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.995993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.995993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.996336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.011426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.019882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b557fa5e-a939-45d2-a4d5-98eac26b3d75 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.084263 Aug 24 07:57:45.020466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 330/700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:45.131126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.138815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c8ebec7d-d263-44ad-9f02-c7ea7b8b9726 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156829 Aug 24 07:57:45.139382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 371/701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:45.539330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.539928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.547119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.547736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.548159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.548876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.549319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.549728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.557578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.558183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.565357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.565830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.566264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.566942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.567391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.567802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.613479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.621592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.623066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.624150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6c5f1f5-cf7c-46ce-be9c-7971eeff400d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.088684 Aug 24 07:57:45.625590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 331/702] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:45.629095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.636809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5e2c991e-1c2e-40ce-8670-b141801ee7e6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083052 Aug 24 07:57:45.637425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 372/703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:46.040472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.041111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.047827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.048296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.048765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.049452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.049893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.050307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.054360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:46.114143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.121638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8a7af48a-a799-4e67-8802-7b125efa27f6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.084901 Aug 24 07:57:46.122205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 332/704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:46.161013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.161618 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.167550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.168024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.168452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.169164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.169608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.170022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.302560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.310510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b06963e3-2d10-48c6-a05d-ff71d6867b36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153258 Aug 24 07:57:46.311086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 373/705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:46.648815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.649419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.656110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.656581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.657066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.657600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.658029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.658168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.658278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.658583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.664284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.664793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.665233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.665923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.666376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.666820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.720086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.728441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.728628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.729965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.731048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4a87247f-9ea4-4f3a-9e53-ea0cf0a14b41 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.086162 Aug 24 07:57:46.731735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 333/706] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:46.736924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-27a52575-428d-4040-8089-c3c96d212875 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083036 Aug 24 07:57:46.737492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 374/707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:47.141138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.141680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.147598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.148070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.148499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.149205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.149650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.150067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.208973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.216402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bc50c69a-8aab-4897-a3f2-b09adb116278 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.079359 Aug 24 07:57:47.217004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 334/708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:47.331325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.331931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.333797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:47.338592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.339063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.339488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.340165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.340606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.341049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.471637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.479355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-29836c27-7ebe-4f39-81f0-2881f1034411 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152023 Aug 24 07:57:47.479933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 375/709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:47.753710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.754260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.760557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.761057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.761479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.762149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.762592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.763001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.814110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.814722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.821758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.821856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.822254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.823202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.823652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.824069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.824168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.833460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.834969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.836054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7dda0bfb-d454-4f72-888d-2e34bfe41f61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.086583 Aug 24 07:57:47.836609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 335/710] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:47.886924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.895083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-190b9470-bdfe-4394-9390-ad8e7e55827e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084985 Aug 24 07:57:47.895682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 376/711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:48.236516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.237149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.243093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.243520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.243947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.244617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.245092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.245508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.309069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.317149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d5456d79-ef1a-43d7-8e8a-27e567fe68eb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.084687 Aug 24 07:57:48.317713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 336/712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:48.501591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.502189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.508054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.508523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.508984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.509651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.510088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.510494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.643676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.647104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:48.651649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-31aaf7d7-6593-4ec2-86d9-609f0c55a3bc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154788 Aug 24 07:57:48.652223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 377/713] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:48.859273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.859792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.866817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.867288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.867714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.868395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.868875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.869297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.916326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.916964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.924497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.925017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.925454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.926143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.926600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.927025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.929832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.938162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.939821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.940946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9aa76b95-74d2-49ae-8f59-4e30c5f7b239 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.085639 Aug 24 07:57:48.941507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 337/714] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:48.988069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.995828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-30ad1da2-a4a9-42a2-9946-8515ef5809ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083328 Aug 24 07:57:48.996398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 378/715] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:49.337611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.338215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.344078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.344713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.345252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.345923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.346370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.346789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.405556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.412982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b6a03ec-6060-43eb-a062-909ff352041f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.079173 Aug 24 07:57:49.413546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 338/716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:49.673557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.674172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.680186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.680638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.681092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.681760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.682202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.682620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.815176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.823400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d72b3379-09b3-430f-83c0-a3d74bae7800 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154486 Aug 24 07:57:49.823972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 379/717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:49.964102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.965183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.968074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:49.974411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.974879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.975303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.975974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.976414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.976860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.016784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.017552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.023732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.024328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.024784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.025466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.025907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.026317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.038996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.047090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.048938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.050060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b19ba9b-8598-4c2e-b84e-816ac4c2802b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.090340 Aug 24 07:57:50.050626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 339/718] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:50.089222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.097776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-750fcbd2-dbcc-42d9-8326-dbc1e4cb6b62 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085311 Aug 24 07:57:50.098504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 380/719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:50.433715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.434348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.441224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.441224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.441665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.442343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.442785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.443200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.506288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.513808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d16d2ebd-ff00-4de4-8c8e-53e8d7dd8fd0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.083898 Aug 24 07:57:50.514370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 340/720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:50.844565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.845231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.851615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.852094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.852555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.853269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.853719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.854147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.984411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.992755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b89f44a4-ca1c-46ce-aad7-7dd2135a14e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152153 Aug 24 07:57:50.993318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 381/721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:51.071335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.073167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.079364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.079841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.080268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.080976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.081425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.081842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.117624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.118236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.124426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.125059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.125824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.126617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.127062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.127479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.145007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.154599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.161480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.162875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-40d6da9d-93cb-40d6-ad03-796fb39a327a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.095350 Aug 24 07:57:51.163443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 341/722] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:51.192751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.200826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff7291aa-dd03-4fad-9a54-268942248277 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086935 Aug 24 07:57:51.201388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 382/723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:51.535278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.535868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.537713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=10 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:51.542482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.542956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.543382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.544060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.544536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.544982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.604911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.612490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1c492c00-6afb-4a8c-bc86-8535b370ca7c tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081705 Aug 24 07:57:51.613084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 342/724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:52.014338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.014944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.022073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.022547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.022991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.023655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.024100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.024514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.155800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.163456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-842a50a9-3fa8-414d-8af4-30a307f56ed1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153038 Aug 24 07:57:52.164014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 383/725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:52.189978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.189978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.194012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.194526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.194959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.195830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.196088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.196511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.229802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.230410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.233315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:52.237389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.237866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.238302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.238991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.239437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.239856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.259796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.268401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.269883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.271009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-978ef951-7dec-4010-af52-085942b31d61 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.089072 Aug 24 07:57:52.271758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 343/726] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:52.303387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.311095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c9058311-c102-4cb4-8f21-3aea57b70624 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085240 Aug 24 07:57:52.311662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 384/727] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:52.633038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.633638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.639528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.640013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.640445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.641208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.641658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.642081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.705883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.713755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-91224241-96f7-4a87-b583-8803f7e365e4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.084565 Aug 24 07:57:52.714322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 344/728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:53.183613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.184219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.190562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.191061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.191490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.192181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.192628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.193067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.293325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.293922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.301012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.301497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.301932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.302626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.303134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.303556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.329891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.337635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-13c22131-52af-4b2c-8109-8b11bfef59b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158198 Aug 24 07:57:53.338205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 385/729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:53.342545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.343150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.349442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.349915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.350343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.351254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.351702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.352117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.366771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.374954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.376830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.377916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b697fb7-9f73-4b9c-a955-aa7ca5ac56a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.088487 Aug 24 07:57:53.378474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 345/730] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:53.412893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.420585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6028259f-2aa0-4b6b-8451-683afa6ca5cc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081451 Aug 24 07:57:53.421174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 386/731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:53.734907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.735509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.741508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.750502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.750502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.750502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.750502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.750918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.803485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.811205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72bb9d29-ed4d-4f64-be33-583934804972 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.080143 Aug 24 07:57:53.811805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 346/732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:54.359128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.359794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.366230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.366697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.367120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.367791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.368244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.368678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.400451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.401196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.408526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.409101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.409601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.410411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.410863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.411283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.475349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.483478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.485746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.486947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c2dc942f-66b7-4549-9fa8-e19f86531a6c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.090373 Aug 24 07:57:54.487519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 347/733] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:54.491866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.492458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.495405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.499187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.499662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.500993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.501176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.501861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.502311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.502734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.509662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f46e55b-00b9-40dd-a9f5-02240c0ce13b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154263 Aug 24 07:57:54.515002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 387/734] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:54.566184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.568326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.574706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-83ac0448-b1c5-4d1f-82ea-a0a90f0908d0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086249 Aug 24 07:57:54.575267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 348/735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:54.831787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.832391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.838284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.838747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.839180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.839846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.840287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.840729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.899188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.907595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2770a007-fb77-438b-b3dd-b88b317680b0 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.079910 Aug 24 07:57:54.908155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 388/736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:55.509990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.510552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.517435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.517900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.518322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.518990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.519430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.519842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.534031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.534701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.541118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.541586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.542006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.542687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.543129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.543538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.582172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.590642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.592164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.593390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-911098a7-e07d-4e4f-887a-420450e185f4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.087886 Aug 24 07:57:55.594478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 349/737] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:55.599509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.600200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.607488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.607811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.608241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.608953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.609399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.610555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.670301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.678999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a5a423b6-bd64-4485-8c6e-f51036616f6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083086 Aug 24 07:57:55.679580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 350/738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:55.680265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.688627 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d7559390-da3a-41f9-8a34-9de306c8f718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157961 Aug 24 07:57:55.689227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 389/739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:55.927279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.927887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.933906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.934385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.934823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.935503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.935952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.936371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.996930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.005152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-40de0228-3005-44ac-89c3-7d74316118d2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081724 Aug 24 07:57:56.005735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 351/740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:56.616814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.617414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.623730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.624200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.624620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.625459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.626099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.626517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.685504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.693868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.695349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.696431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6194d298-4c95-403c-a9af-eaecdde68349 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.083543 Aug 24 07:57:56.697011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 390/741] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:56.700539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.701182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.708661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.709235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.709673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.710107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.710367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.710739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.710848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.711224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.716762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.717238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.717685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.718388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.719654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.720001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.776137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.784733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-87ba7b3c-1f5d-4368-9031-5add64575e92 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088084 Aug 24 07:57:56.785318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 352/742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:56.852315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.860261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-deb77891-3921-462d-9ba8-5cce06ea4d0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153750 Aug 24 07:57:56.860870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 391/743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:57.025304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.025905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.032767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.033246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.033683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.034362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.034889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.035281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.095338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.102916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f13481b-96c4-4116-a804-18a1efd38ae2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081434 Aug 24 07:57:57.103476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 353/744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:57.720006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.720533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.726974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.727441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.727879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.728539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.729013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.729428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.793268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.802294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.803965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.805105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b6aabebb-ed69-4c42-9c86-0a2fc806a14a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.089260 Aug 24 07:57:57.805670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 392/745] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:57.805902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.806419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.813293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.813778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.814204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.815598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.816052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.816467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.881359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.881969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.883242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.888069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.888546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.889042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.889806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.890255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.890678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.892027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cef81684-97a4-4db9-b39a-9eb305e60303 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090095 Aug 24 07:57:57.892600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 354/746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:58.029650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.038455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-629d6481-6dd9-451c-b4a7-56c117cc11a0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.160952 Aug 24 07:57:58.039029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 393/747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:58.123261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:58.126785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:58.130708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.131186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.131613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.132297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.132779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.133199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.197995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.206373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4500b9f7-d945-4f0a-b5b4-5fa88c4026b2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.087020 Aug 24 07:57:58.206939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 355/748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:58 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:58.828044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:58.828893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:58.835192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.835666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.836097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.836820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.837270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.837688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.856075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:58.898495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.907657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.909205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.910312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a394cb8e-7377-4902-8172-bb379d006b45 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.086175 Aug 24 07:57:58.910878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 394/749] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:58 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:58.912904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:58.913568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:58.920107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.920582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.921041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.921722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.922810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.923321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.987840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.995423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ba24803e-c380-420b-b1e9-76b8c4b61f98 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086341 Aug 24 07:57:58.995976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 356/750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:59.059150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.059750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.066623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.067094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.067515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.068194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.068635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.069071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.199532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.207366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df60ba34-3107-459c-9c4e-2b546a0861fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152002 Aug 24 07:57:59.211426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 395/751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:59.226761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.227351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.233290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.233746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.234170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.235471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.236065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.236482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.296527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.304630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ca2349d5-0eed-4e30-82fe-e38f4b565443 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081632 Aug 24 07:57:59.305227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 357/752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:59.933295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.934046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.941783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.942391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.942977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.943812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.944320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.944866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.006762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.015072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.017120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.017539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.018150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.018896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-28c9a893-9d0a-46c3-ab08-08c62e9badd9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.089912 Aug 24 07:58:00.019428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 396/753] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:00.024406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.024929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.025357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.026050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.026503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.026920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.089168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.097186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fc2a7873-f73c-49a5-812b-1762c3ec4930 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084078 Aug 24 07:58:00.097749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 358/754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:00.230771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.231295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.237684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.238154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.238580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.239255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.239683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.240091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.325782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.326474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.333160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.333637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.334063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.334777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.335228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.335698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.373772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.382554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4444dd11-831b-49cb-82bc-81d3819aff65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155651 Aug 24 07:58:00.383214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 397/755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:00.397067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.404946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1e373f2d-c023-4ff8-adba-c57d81a96f73 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.083167 Aug 24 07:58:00.405710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 359/756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:01.041785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.042401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.049456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.049925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.050347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.051017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.051463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.051873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.111383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.117940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.118570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.119690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.121305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.122460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fe4d0716-df87-4e1c-b4f2-53830338d49f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.084614 Aug 24 07:58:01.123030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 398/757] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:01.126460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.127180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.127357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.128032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.128611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.129049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.193841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.203700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7fa8920b-cb65-4bde-8e6b-b9074ba4a032 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089078 Aug 24 07:58:01.204275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 360/758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:01.403200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.403813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.410602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.411065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.411498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.412177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.412628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.413095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.425825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.426450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.432235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.432734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.433157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.433832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.434377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.434683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.495962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.503709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-010c66c4-8ef6-4d14-884a-dfc67377e837 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.082027 Aug 24 07:58:01.504279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 361/759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:01.545560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.553244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fdf36019-f286-4bb7-b414-0941e8d844ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153891 Aug 24 07:58:01.553802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 399/760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:02.145074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.145683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.152185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.152669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.153119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.153795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.154240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.154655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.214897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.223293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.224616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.225112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.225250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.225894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9babaa2b-c162-481f-b5a3-2ff8ff7d349a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.084713 Aug 24 07:58:02.226448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 362/761] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:02.231838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.232307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.232753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.233432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.233872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.234818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.298144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.305867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e1419573-e1fe-4e70-add3-cb33db429bc0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085021 Aug 24 07:58:02.306439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 400/762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:02.524659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.525296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.531891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.532403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.534250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.534250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.534250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.535059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.574905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.575548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.581577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.582050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.582479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.583155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.583593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.584004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.597029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.604757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a8e48278-81b0-4d23-9433-0df66a93082b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.084104 Aug 24 07:58:02.605583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 363/763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:02.720757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.728440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3595f380-e719-4ed8-921d-62cc7c0ccfb9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157642 Aug 24 07:58:02.729248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 401/764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:03.249285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.250471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.256957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.257431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.257855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.258523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.258963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.259372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.321639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.327499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.328824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.331005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.332514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.333653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b0346b04-a51e-421c-9bc6-d3b6eef1e910 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.088320 Aug 24 07:58:03.334246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 364/765] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:03.335002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.335480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.335913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.336595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.337085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.337503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.397875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.405497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cfa74584-8be6-40c0-a18a-2a0f8c4d186f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081891 Aug 24 07:58:03.406148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 402/766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:03.627114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.627729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.633648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.634142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.634566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.635234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.635672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.636080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.650539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:03.696116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.704118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-88a13316-fbde-4d25-b11d-7497368b5c3d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081415 Aug 24 07:58:03.704707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 365/767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:03.749816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.762115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.762115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.762115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.762115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.763344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.763344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.763344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.895983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.986482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ee7c75a-168c-4a97-b744-5f6c22381b26 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157745 Aug 24 07:58:03.986482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 403/768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:04.356237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.356944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.363820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.368633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.368633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.368633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.368633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.369027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.426339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.426976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.428139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.433453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.433921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.434368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.435050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.435490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.435900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.436147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.437742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.438932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84f5ba45-6869-498e-92e8-f541c985c695 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.086862 Aug 24 07:58:04.439488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 366/769] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:04.496690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.504247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-72990f90-861c-40d6-822f-0fa49bcf0b56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081809 Aug 24 07:58:04.504987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 404/770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:04.723957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.724480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.730519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.730986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.731414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.732084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.732521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.732977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.793007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.801017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4632fed0-3078-48c4-8cdd-5d96899dca3b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081254 Aug 24 07:58:04.801556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 367/771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:05.006875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.007481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.013511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.013988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.014417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.015097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.015665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.016087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.147127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.152948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83542bce-d4d5-48cd-9a6c-4b5dd7cebd60 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149979 Aug 24 07:58:05.153521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 405/772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:05.462316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.462914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.469595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.470058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.470517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.471191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.471630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.472041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.525669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.526407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.533169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.533649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.534080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.534780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.535232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.535656 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.535754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.543977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.545500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.546600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-087bd89e-b4b6-40b5-b8eb-40ec550d66f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.088137 Aug 24 07:58:05.547580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 368/773] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:05.598132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.605721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce08f68d-4962-4fcd-90f9-81855aa39678 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083998 Aug 24 07:58:05.606283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 406/774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:05.821318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.827810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.828331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.828843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.829272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.829948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.830389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.830803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.891409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.898942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c7402871-67a0-4d5d-9b15-0981b0f8ef55 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081363 Aug 24 07:58:05.899512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 369/775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:06.175101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.175653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.181566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.182037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.182460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.183129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.183565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.183973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.315916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.324561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce84e102-7e98-4f12-b7c2-fbe31cbab23e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153840 Aug 24 07:58:06.325394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 407/776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:06.568589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.569222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.575974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.576449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.576900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.577636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.578600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.579016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.627635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.628392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.635077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.635557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.635995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.637219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.637319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.637724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.639601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.648989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.650591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.651757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9c0fbb36-acbb-43e1-9807-30aef5ad9291 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.087097 Aug 24 07:58:06.652401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 370/777] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:06.701082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.709435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9a6dbcbd-c9b2-4db3-b6aa-9315dbdbb756 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086106 Aug 24 07:58:06.710001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 408/778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:06.919403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.919999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.926422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.926889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.927312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.927984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.928421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.928865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.990385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.997819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1814fcb9-de72-409e-a8d5-1174cc723d1f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.082410 Aug 24 07:58:06.998384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 371/779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:07.347494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.348104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.354251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.354723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.355150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.355824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.356268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.356702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.487610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.495242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8470fcd8-0e0a-4001-83fe-39ff40c891a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151593 Aug 24 07:58:07.495826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 409/780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:07.675347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.675974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.682514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.682986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.683479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.684160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.684610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.685072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.730788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.731363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.738613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.739110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.739540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.740218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.740670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.741097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.751186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.759384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.760905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.761993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bda5ecb6-6391-4944-bad3-4a8f182b1be8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.091147 Aug 24 07:58:07.762550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 372/781] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:07.803493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.811279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25c53e38-f7ab-421d-a44d-3a5f6d6e0840 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084290 Aug 24 07:58:07.811850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 410/782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:08.019114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.019722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.025645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.026117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.026545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.027217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.027661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.028078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.088121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.096344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25e70b96-2463-4b00-b06a-8c0141ebca06 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.081556 Aug 24 07:58:08.096956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 373/783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:08.517697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.518297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.524183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.524665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.525099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.525806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.526245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.526662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.530595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:08.656878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.664675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9a9393a2-778a-40c5-b03d-dea602667339 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151634 Aug 24 07:58:08.665249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 411/784] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:08.783758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.784272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.790714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.791181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.791654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.792327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.792793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.793206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.831309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.831930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.838536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.839021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.839459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.840160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.840606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.841049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.853957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.862665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.864139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.865248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e74ce32-f671-44ed-8e8e-74d454ea6d60 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.085843 Aug 24 07:58:08.865802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 374/785] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:08.902631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.910403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c05f343-6599-46fe-a0aa-3ae6f7cd06d9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083032 Aug 24 07:58:08.910960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 412/786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:09.116274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.116899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.122742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.123208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.123633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.124304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.124806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.125365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.184440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.191981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e3fe2f5d-411f-4ad1-81d1-191932aa258d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.079411 Aug 24 07:58:09.192540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 375/787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:09.685271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.685871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.691831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.692296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.692746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.693417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.693858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.694268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.826318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.834774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1338eb71-0994-4f85-a4cc-5145a9522868 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153232 Aug 24 07:58:09.835360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 413/788] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:09.888112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.888736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.895667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.896130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.896565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.897271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.897717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.898131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.931338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.931869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.938858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.939339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.939770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.940458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.940932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.941352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.960942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.969201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.970770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.971861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e3f8aed8-2777-4806-ac45-7bd1a694df80 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.087620 Aug 24 07:58:09.972415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 376/789] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:10.003019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.010795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b963862-7464-4982-83d7-ad6ab0f7c305 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083349 Aug 24 07:58:10.011356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 414/790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:10.212442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.213020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.219492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.219963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.220389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.221088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.221529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.221938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.281667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.289120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e780ce4c-bd20-49c4-9e64-44090473a7be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.080498 Aug 24 07:58:10.289678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 377/791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:10.855267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.855877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.862677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.863145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.863576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.864253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.864721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.865138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.995205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.995835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.996108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.003052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.004123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.004123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.004341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1fa62363-3ec9-4383-85b8-c751cec9eadd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152599 Aug 24 07:58:11.004612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 415/792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:11.004865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.005310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.005721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.031876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:11.032497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:11.038501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.038978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.039413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.040100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.040569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.041016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.067773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.076208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.078205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.079697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a3b85e4e-2e52-4bb1-85b0-5287288fe25d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.088485 Aug 24 07:58:11.080259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 378/793] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:11.103070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.111381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8a8e51a0-2da9-480a-bb92-ac1e755dfe07 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083949 Aug 24 07:58:11.111886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 416/794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:11.310265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:11.310858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:11.317693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.318162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.318590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.319254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.319693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.320109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.380949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.388441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e8efcaa-8b54-4c6e-b418-62e8543de2d5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.082034 Aug 24 07:58:11.389035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 379/795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:11 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:12.025803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.026341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.032871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.033351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.033808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.034465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.034912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.035328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.102257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.102959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.110014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.110537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.110971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.111662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.112110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.112917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.167195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.176201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6e81ca2-da07-4ae1-a06a-6312b3ac9048 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154231 Aug 24 07:58:12.176372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.188868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 417/796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:12.188868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.188868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.188868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.189546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.189546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.189822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.190456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.191050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.196829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.198716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.199897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-882d5809-28da-48ef-846a-e700b6ea0586 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.101665 Aug 24 07:58:12.200851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 380/797] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:12.252475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.260131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4260e721-077f-4902-b569-41faccbfb1de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082082 Aug 24 07:58:12.260790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 418/798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:12.409527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.410173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.416795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.417271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.417727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.418446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.418890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.419306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.480852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.488828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-657a5831-b7fb-4841-819d-8a6a28517e92 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.083948 Aug 24 07:58:12.489424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 381/799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:13.198576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.199185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.206266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.206740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.207170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.207858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.208303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.208749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.222497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.223127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.229441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.229901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.230325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.231008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.231447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.231862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.237815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:13.299498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.307870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.309412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.310512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-92c2a0af-c1d4-4ef8-9d49-f326d78a68a5 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.091879 Aug 24 07:58:13.311070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 382/800] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:13.317514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.318108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.324589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.325242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.326442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.327137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.327684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.328107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.347578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.355379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-70dc1963-0abe-4225-84b2-19165906f66b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.161014 Aug 24 07:58:13.355957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 419/801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:13.389713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.397893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-adcf9295-7968-4ce7-b299-0fe6027c7905 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083905 Aug 24 07:58:13.398461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 383/802] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:13.508670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.509318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.515503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.515973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.516400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.517110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.517557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.517972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.578817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.586802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-343b430f-cfe8-4113-a560-dd3bbe8b870a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.082266 Aug 24 07:58:13.587596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 420/803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:14.333908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.334629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.341999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.341999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.342375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.343100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.343660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.344116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.377513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.378157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.385183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.385713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.386186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.386923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.387456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.387915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.410843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.418994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.420476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.421822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3788ccc9-4331-43de-8c99-7f6b46611143 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.092009 Aug 24 07:58:14.422388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 384/804] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:14.426694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.427282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.433362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.433831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.434250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.434928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.435368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.435781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.498001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.506537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-207cf61f-284a-4f69-b13c-779909646962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083193 Aug 24 07:58:14.507133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 385/805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:14.525730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.534619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24708df9-3aa0-43c4-91b6-4e496462808b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.161301 Aug 24 07:58:14.535244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 421/806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:14.607242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.607850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.614212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.614690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.615122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.615800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.616244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.616679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.675756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.683353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-63d6d595-40d7-458b-bfae-0199e29359d4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1245 microversion: 2.1 time: 0.079961 Aug 24 07:58:14.683920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 386/807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:15.445176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.445794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.453160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.453653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.454116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.454803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.455254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.455677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.514479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.523154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.524673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.525839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-17f23798-0cd9-412c-9f59-f8645da03d78 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.084524 Aug 24 07:58:15.526398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 422/808] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:15.527124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.527684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.534959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.535426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.535857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.536550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.537034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.537455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.555192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.555807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.561783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.562290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.562720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.563402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.563873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.564290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.598824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.606664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7d06c162-00c4-4d94-b3de-aa3357994a4a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083312 Aug 24 07:58:15.607571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 387/809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:15.697776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.703495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.704095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.706329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b85e3cd-5e34-4202-b129-65f5833ddb1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154914 Aug 24 07:58:15.706912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 423/810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:15.710107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.710608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.711036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.711715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.712159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.712573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.775075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.782742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f7360ac3-ca45-475a-81f1-49c9169638b5 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1237 microversion: 2.1 time: 0.083117 Aug 24 07:58:15.783298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 388/811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:16.548384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.549005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.555748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.556228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.556682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.557376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.557848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.558266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.628350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.629013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.636199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.636697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.637133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.637832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.638338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.638721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.704932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.713102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-43b4c318-0953-48bd-88db-ae077c0516ac tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089441 Aug 24 07:58:16.713682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 389/812] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:16.726985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.727585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.733539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.734379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.734916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.735631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.736072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.736486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.768510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.776791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.778320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.779416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7003e838-920a-45b5-a004-06eeeb244c30 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1286 microversion: 2.20 time: 0.235275 Aug 24 07:58:16.780039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 424/813] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1286 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:16.807180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.807785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.814457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.814928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.815351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.816026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.816464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.816899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.872088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.880866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-452b4325-1a51-480c-aa5d-f2f4c47616aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157519 Aug 24 07:58:16.881514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 390/814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:16.882808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.891418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4636e4a3-f01b-41ae-9d39-91611207b36b tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1237 microversion: 2.1 time: 0.087414 Aug 24 07:58:16.891908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 425/815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:17.734427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:17.734995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:17.741506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.741983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.742412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.743096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.743540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.743955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.804017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:17.804733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:17.819457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.820118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.820964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.822060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.822998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.823648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.841399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.850534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f41207d2-d251-4768-a13e-fc568196cabd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.120071 Aug 24 07:58:17.851675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 391/816] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:17.902987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:17.903587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:17.910844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.911016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.911480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.911910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.913896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.914570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.915658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.920193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.921975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.923194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1e333cc2-929c-40ea-be4e-b79661c40455 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1278 microversion: 2.20 time: 0.123744 Aug 24 07:58:17.923739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 426/817] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:17 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:17.941178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:17.941931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:17.948860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.949339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.949800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.950494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.950945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.951367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.014507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.019420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:18.023802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f52222dc-3c6d-4fd5-86df-c24b0d24c9f2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1293 microversion: 2.1 time: 0.089490 Aug 24 07:58:18.024564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 427/818] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:17 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:18.060540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.068938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25dc5074-3cd6-4bb1-bb8a-fb84cf9aef1e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.170351 Aug 24 07:58:18.069500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 392/819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:18.871725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:18.872327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:18.880842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.881326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.881757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.882440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.882916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.883331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.961120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:18.961902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:18.971966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.975594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.975714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.975995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.975995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.975995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.975995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.984349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f5192eb1-ab3f-40b8-bea4-0a9822bd53c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.116283 Aug 24 07:58:18.996679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 428/820] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:19.046070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:19.046994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:19.053609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.054077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.054509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.055625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.056345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.056992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.063120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.078628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.087021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.089030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ab78831-b73e-496b-8c02-7be74ae7eecb tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1342 microversion: 2.20 time: 0.135025 Aug 24 07:58:19.090607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 393/821] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:18 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:19.094750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:19.095398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:19.101460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.101934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.102359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.103038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.103476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.103887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.137894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.146773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a5d3d29-00cc-4c9f-9ec9-c63b0ba31c2d tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1299 microversion: 2.1 time: 0.105420 Aug 24 07:58:19.147348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 429/822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:19 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:19.312533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.320372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9c886d31-6627-4a25-8c14-de94b205f385 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.229812 Aug 24 07:58:19.320982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 394/823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:20.008635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.009578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.019411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.020244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.021087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.022076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.022687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.023260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.094893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.103666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f1d39b6-51f4-44f9-80a5-de633201bd69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.098172 Aug 24 07:58:20.104171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 430/824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:20.116099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.117577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.125179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.125960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.126575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.127473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.128134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.128788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.174206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.175327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.195170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.196186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.196785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.197940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.198484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.199017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.388106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.398882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.400431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.402081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-81e1aeda-7e0f-4fa6-bd65-6b903baefcef tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.290093 Aug 24 07:58:20.402763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 395/825] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:20.407934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.408851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.415322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.415983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.416575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.417465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.418085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.418654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.445215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.457518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-958a93c4-2836-499f-a876-fb705cd356be tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.290590 Aug 24 07:58:20.458239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 431/826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:20.628790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.636685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-86b8a8e9-45f3-4dda-b9e8-e6606fa791a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.232631 Aug 24 07:58:20.637510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 396/827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:21.052368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0e3ad6-3c71-43d7-921a-b1799ac33883", "tag": "bd11c2f6-baab-4212-9ebb-6dce218ba73a"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:21.062509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.063700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.064132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.077443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] Creating event network-changed:bd11c2f6-baab-4212-9ebb-6dce218ba73a for instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 on hv-cinder-85427 Aug 24 07:58:21.080264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784c3d15-1dbe-418f-a7e4-dfb43cbc784d", "tag": "a76bdc8f-0427-48b3-bd6d-69ed31bfbbca"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:21.082956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-6c6c46f0-9046-4311-9e8b-8d509530f8d6 req-75cca239-9ac1-462e-a3e9-bdd2494ad978 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090346 Aug 24 07:58:21.083902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 432/828] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:21.090978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.091662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.092090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.104871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] Creating event network-changed:a76bdc8f-0427-48b3-bd6d-69ed31bfbbca for instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d on hv-cinder-85427 Aug 24 07:58:21.110271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-168fdbae-0f42-459d-a2c4-e8f9b59c03ba req-c1ba8348-9c37-4b37-8f71-0ff06be15b81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034407 Aug 24 07:58:21.110879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 397/829] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:58:21.129937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.130677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.137178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.137652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.138375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.139112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.139733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.140440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.224838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.228885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-351434a3-8d9c-4dd4-b3da-9ed16ff71310 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.103155 Aug 24 07:58:21.229686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 433/830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:21.429136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.429843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.431882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:21.438008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.438501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.438935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.439642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.440090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.440537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.478840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.479439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.482510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:21.487240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.487980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.488403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.489130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.489739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.490155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.660392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.668905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.670494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.672514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2d6f6afd-9bd2-4357-a1e3-0b52da200b6d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.247998 Aug 24 07:58:21.673386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 398/831] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:21.677981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.678846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.685060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.685772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.686407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.688807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.689491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.690063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.709647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:21.818098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.826660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1946e77-a6fb-4f5a-883b-ac458b560ed4 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.351482 Aug 24 07:58:21.840064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 434/832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:21.927370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.933000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-793e5673-f6b5-4816-bb47-6edcd0e1bf45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.258239 Aug 24 07:58:21.933663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 399/833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:22.251574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.252096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.258623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.259093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.259517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.260191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.260633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.261075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.320724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.329138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-de99e15b-e7f5-4723-ac5f-d200b3c5e1ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081723 Aug 24 07:58:22.329694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 435/834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:22.699085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.699762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.707288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.707799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.708261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.709060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.709562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.709991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.843233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.847652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.848285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.851448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.852944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.854024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-645066ed-2478-4fdf-a274-867117c842b1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.159380 Aug 24 07:58:22.854294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.854580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 400/835] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:22.854763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.855183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.855858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.856298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.856751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.955285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.955956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.962312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.962822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.963330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.964016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.964464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.964942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.068328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.077363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-583defee-4644-4118-bbaa-c8a56b946204 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.233617 Aug 24 07:58:23.078201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 436/836] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:23.101106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.109952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e12f4ead-2398-42b8-8163-02bc69503e28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158368 Aug 24 07:58:23.110551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 401/837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:23.349702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.350305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.356629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.357123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.357564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.358213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.358699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.359372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.420212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.428428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8efc3fdc-f261-47d2-88a9-6330f475b24f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082514 Aug 24 07:58:23.429043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 437/838] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:23.876840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.877437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.883830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.884297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.884753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.885428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.885871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.886282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.015019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.023444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.024940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.026018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b3997957-1b8a-4b00-b813-46b07375b117 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.153720 Aug 24 07:58:24.026592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 402/839] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:23 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:24.098578 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.099186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.105108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.105582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.106011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.106750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.107227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.107648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.130412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.130939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.136964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.137433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.137860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.138532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.138968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.139379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.239766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.247431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bc5757af-cead-4e0b-8e8d-7be58334fe22 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.152695 Aug 24 07:58:24.247987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 438/840] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:24.274542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.283159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9a2fe225-4d97-4ad8-af05-a5d4350303e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156549 Aug 24 07:58:24.283887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 403/841] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:24.449734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.450332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.457601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.458077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.458502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.459177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.459615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.460022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.525545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.534783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a12476a2-593b-4b0b-9a0d-649e7eb59f8f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089077 Aug 24 07:58:24.535357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 439/842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:25.049747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.050308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.056740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.057216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.057643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.058321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.058766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.059735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.188020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.196477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.198335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.199496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6a8cd93e-9baa-4f1b-9585-ff884ae8fa5c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.154743 Aug 24 07:58:25.200095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 404/843] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:25.267646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.268246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.274203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.274668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.275087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.275757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.276195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.276603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.304867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.305480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.311388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.311993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.312429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.313147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.313597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.314015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.405015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.413655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f624a537-fcc8-4753-9c65-bf00899a287f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.150282 Aug 24 07:58:25.414223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 440/844] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:25.450051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.458206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25461078-b00c-44ed-a134-634c5239fd45 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157168 Aug 24 07:58:25.458821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 405/845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:25.556351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.556926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.564420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.564939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.565377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.566068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.566521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.566945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.627941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.635600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3d1b95e9-f739-4e25-a4a2-ac0982ced0c1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083361 Aug 24 07:58:25.636151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 441/846] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.222865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.223508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.230234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.230716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.231184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.231937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.232448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.232929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.364785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.372956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.374602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.375686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-77b1b672-42bf-49f8-b01f-430a60478cc9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.156967 Aug 24 07:58:26.376258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 406/847] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:26.435363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.435995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.442512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.443021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.443492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.444214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.444706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.445217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.479539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.480059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.486875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.487353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.488038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.488513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.488986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.489594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.588264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.602623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-97583e90-25c5-48ca-99dc-d401472968c9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.171071 Aug 24 07:58:26.603269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 442/848] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.633524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.642161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3c385ac1-2ed5-4a5b-8b6a-d43af6fb7020 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.166692 Aug 24 07:58:26.642964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 407/849] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.661321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.661923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.667826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.668303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.668750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.669431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.669880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.670296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.731850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.740011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4711ed19-acce-40f6-ac90-25ce545fdd2b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082547 Aug 24 07:58:26.740576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 443/850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.862179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0e3ad6-3c71-43d7-921a-b1799ac33883", "name": "network-vif-plugged", "status": "completed", "tag": "bd11c2f6-baab-4212-9ebb-6dce218ba73a"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:26.871321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.871785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.872202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.885284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] Creating event network-vif-plugged:bd11c2f6-baab-4212-9ebb-6dce218ba73a for instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 on hv-cinder-85427 Aug 24 07:58:26.890500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-12ef9317-7356-4ba3-b547-715b87f27479 req-9fbff68a-e64c-4181-9357-27562678cba8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094044 Aug 24 07:58:26.891066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 408/851] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:58:27.399077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:27.399612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:27.406402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.406869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.411724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.411724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.411724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.411724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.543127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.551371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.553046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.554131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a5b44414-380b-4fae-a1ed-a4dc5a8a56e0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1408 microversion: 2.20 time: 0.159238 Aug 24 07:58:27.554680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 444/852] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:27 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:27.624366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:27.625106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:27.631224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.631698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.632132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.632851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.633301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.633718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.663238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:27.663796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:27.670264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.670727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.671190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.671922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.672322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.672761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.677764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:27.771697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.779896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-20762381-f558-4560-89d8-d9b0443b3961 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.160228 Aug 24 07:58:27.781254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 409/853] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:27 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:27.786027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:27.786701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:27.792842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.793361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.793791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.794553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.795007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.795463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.815274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.823536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc1226d9-3d1f-406a-86da-8204218564b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.164104 Aug 24 07:58:27.824155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 445/854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:27.858915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.866489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-202f74c2-5b85-4f17-a770-1d6a6fcde197 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084214 Aug 24 07:58:27.867053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 410/855] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:28.578054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.578054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.583584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.584064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.584493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.585395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.589222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.589222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.742265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.750955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.752454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.753684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24fb8456-1c64-4bba-8950-bdbbbb979fbf tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1600 microversion: 2.20 time: 0.181305 Aug 24 07:58:28.754316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 446/856] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:28.775889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.776451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.783595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.784069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.784498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.785219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.785664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.786080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.801874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.802498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.808266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.810049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.810049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.810049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.810414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.810708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.868259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c5a03624-edd4-41de-8fd4-baf1780f443a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096146 Aug 24 07:58:28.868890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 411/857] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:58:28.881222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.881836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.887998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.888482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.889632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.890341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.891114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.891544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.034887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.042888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fff48890-2567-44bb-b61b-89642c6a2ecb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.165379 Aug 24 07:58:29.043480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 412/858] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:29.048917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:29.049526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:29.055534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.056018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.056452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.057199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.057652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.058076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.080000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.091096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-15ed761e-792c-4bec-80cd-d00b06619740 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.293020 Aug 24 07:58:29.091672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 447/859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:29.096587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784c3d15-1dbe-418f-a7e4-dfb43cbc784d", "name": "network-vif-plugged", "status": "completed", "tag": "a76bdc8f-0427-48b3-bd6d-69ed31bfbbca"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:29.107477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.107950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.108948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.120672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] Creating event network-vif-plugged:a76bdc8f-0427-48b3-bd6d-69ed31bfbbca for instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d on hv-cinder-85427 Aug 24 07:58:29.126179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-dbd7878f-ea7a-4511-bc45-08629652fcf3 req-96c4f872-c70d-4d7d-9262-5b4cb108e124 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Aug 24 07:58:29.126772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 448/860] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:29.128393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.136113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7f7c7b20-7799-4f04-b8a6-2cf91ec032e9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.091627 Aug 24 07:58:29.136746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 413/861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:29.945181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0e3ad6-3c71-43d7-921a-b1799ac33883", "tag": "bd11c2f6-baab-4212-9ebb-6dce218ba73a"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:29.955946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.956412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.956855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.967468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] Creating event network-changed:bd11c2f6-baab-4212-9ebb-6dce218ba73a for instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 on hv-cinder-85427 Aug 24 07:58:29.973037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-bda4337d-3caa-425a-9673-cbb224c86f5e req-0c3fe069-98e4-4732-a4cf-491e485ebe25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031965 Aug 24 07:58:29.973619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 449/862] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:30.065504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:30.066093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:30.073065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.073545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.073975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.074677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.075122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.075533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.121903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:30.126800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:30.131849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.132736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.133261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.134042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.134559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.135047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.223324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.231308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f00761a7-1085-47bf-a4c4-855171d4c4de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.170218 Aug 24 07:58:30.232058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 414/863] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:30.251252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:30.251962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:30.258422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.258907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.259335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.260214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.260679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.261102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.314476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.322974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca81ebd2-6c6a-4e22-9247-1f10570e4987 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1367 microversion: 2.1 time: 0.205465 Aug 24 07:58:30.324116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 450/864] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:30 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:30.334150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.342347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9ee0ae76-6ca2-426c-a82a-483d3bf3cb1b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.096134 Aug 24 07:58:30.343597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 415/865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:31.257615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.258215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.265210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.265922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.266351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.267032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.267481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.267888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.345983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.346586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.353315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.353788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.354216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.354910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.355351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.355770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.494748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.502991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d9a3c994-c507-4a70-b2ef-751e4e1571af tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1558 microversion: 2.1 time: 0.161973 Aug 24 07:58:31.503585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 416/866] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:31.512865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.512865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.515348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.515840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.516273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.516987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.517431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.518015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.520927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:31.585599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.593901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe0c84a5-972d-43c9-b178-1d0ef4363793 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089308 Aug 24 07:58:31.594684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 417/867] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:31.606681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.607194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.613142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.613614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.614047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.614730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.615227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.615600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.635359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.643644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d6d06cc-6101-4574-af6e-5ae25a517d39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.389913 Aug 24 07:58:31.644221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 451/868] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:31.698444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8e10a23b-ffb5-45f9-baa0-9b8c714afc7e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095508 Aug 24 07:58:31.699040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 418/869] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:32.615927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:32.616531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:32.622667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.623194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.623653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.624840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.625272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.625689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.668309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:32.675472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:32.685622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.690330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.690330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.690330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.690330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.690885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.698094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:32.706942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a755f717-a1f8-4835-87d9-15af64f495f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.094819 Aug 24 07:58:32.707742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 452/870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:32.712602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784c3d15-1dbe-418f-a7e4-dfb43cbc784d", "tag": "a76bdc8f-0427-48b3-bd6d-69ed31bfbbca"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:32.723130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.723685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.724129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.735588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] Creating event network-changed:a76bdc8f-0427-48b3-bd6d-69ed31bfbbca for instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d on hv-cinder-85427 Aug 24 07:58:32.740571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-109f7a63-d61e-463a-aa5e-7f977e89d155 req-bdca5bd8-1bd3-4aa6-a09d-07d8ec6aa3c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031364 Aug 24 07:58:32.741203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 453/871] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:32.838334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:32.846892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bddaeecf-a308-4ed5-9370-bb8a75d1b0f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.184629 Aug 24 07:58:32.847767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 419/872] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:33.732838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:33.734057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:33.750178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.750838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.751340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.752142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.752837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.753352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.819272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:33.832983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-50374ffc-55df-41a1-a19e-84e00f543475 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.099962 Aug 24 07:58:33.832983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 454/873] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:33.867897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:33.868482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:33.875035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.875503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.875926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.876597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.877065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.877475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.013921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.022074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2f2922ca-cd6c-4c33-ae87-c8168d10a46b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157963 Aug 24 07:58:34.022707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 420/874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:34.849685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:34.850388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:34.857354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.857869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.858372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.859320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.859794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.860264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.925750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.933844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d53b5d37-650b-4a10-9eed-bef4c2a05231 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088449 Aug 24 07:58:34.937843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 455/875] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:35.043410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:35.044046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:35.051155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.051632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.052069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.052797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.053249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.053671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.182700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:35.191112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b37dc741-a96a-4d07-a6ae-e7a0630dd8b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151669 Aug 24 07:58:35.191680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 421/876] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:35.957900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:35.958498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:35.964893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.965363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.965785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.966457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.966900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.967305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.028012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.036501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3850163c-b8ba-4759-89b8-b9bd7ca306dd tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082443 Aug 24 07:58:36.037116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 456/877] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:36.212523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:36.213077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:36.219729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.220204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.220631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.221339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.221781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.222222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.354385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.362279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b8016caf-7f2c-4174-91f2-a6a767e86875 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153671 Aug 24 07:58:36.362840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 422/878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:37.057409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:37.057992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:37.064538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:37.065033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:37.065459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:37.066137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:37.066576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:37.067006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:37.126918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:37.134765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4706c042-c501-49f6-a05a-ae2749fa7a55 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081093 Aug 24 07:58:37.135333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 457/879] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:37.383565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:37.384094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:37.391161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:37.391635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:37.392061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:37.392772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:37.393219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:37.393638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:37.524158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:37.533470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cff03034-430a-46c6-a907-19f141a0546a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153373 Aug 24 07:58:37.533992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 423/880] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:38.155644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:38.156241 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:38.162730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.163200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.163622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.164294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.164774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.165184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.229067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.237371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e1973ccc-ddb4-421e-81df-2391030c1169 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085900 Aug 24 07:58:38.237933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 458/881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:38.553284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:38.553905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:38.560305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.560808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.561321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.562179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.562623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.563035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.692707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.700752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fd2d32b4-1b59-404d-b205-5128fd6154eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151191 Aug 24 07:58:38.701332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 424/882] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:39.258677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:39.259315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:39.266518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.267032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.267506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.268188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.268634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.269077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.329193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:39.336823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c223fd8c-532f-49dd-a278-a5524b9756f5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081980 Aug 24 07:58:39.337383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 459/883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:39.721923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:39.722546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:39.729130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.729598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.730021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.730693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.731132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.731542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.126872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.134705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96ed4d72-4c3e-4f1e-879c-0c6b902fd5f8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.416738 Aug 24 07:58:40.135276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 425/884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:40.357705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:40.358351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:40.364811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.365284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.365710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.366383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.366826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.367234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.426872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.434389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bfd565f8-c6d7-41e8-bf33-915e4b48f156 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080541 Aug 24 07:58:40.434945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 460/885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:41.155465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.156108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.162619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.163095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.163521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.164194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.164638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.165074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.293664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.301970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a7d88fdf-6ecb-4cb7-9a8a-420d668055a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150360 Aug 24 07:58:41.302543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 426/886] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:41.455231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.455840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.462364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.462840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.463267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.463954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.464400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.464850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.526940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.535254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f3a1b9b8-835f-4081-a9e1-ed596d195bf5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083899 Aug 24 07:58:41.535822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 461/887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:42.324037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:42.324666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:42.331322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.331793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.332223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.332937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.333383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.333795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.466883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:42.474997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0fccc781-53e8-4b2d-9f42-08fe84940525 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155463 Aug 24 07:58:42.475633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 427/888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:42.556868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:42.557482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:42.564435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.564936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.565369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.566052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.566502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.566922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.632150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:42.637508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8be59e8-66d8-4886-9f1a-93a4c893b635 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084510 Aug 24 07:58:42.638074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 462/889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:43.496447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:43.497074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:43.503876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:43.504348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:43.504801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:43.505469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:43.505909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:43.506318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:43.638643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:43.647135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-21ebd8e2-d521-4f43-bc74-3df362a0b515 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154484 Aug 24 07:58:43.647693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 428/890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:43.658577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:43.659214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:43.665693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:43.666166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:43.666604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:43.667288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:43.667732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:43.668148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:43.728193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:43.731647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:43.736260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e9f5d00f-d899-45c4-aa2a-ceb2a5cb6dee tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081774 Aug 24 07:58:43.736855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 463/891] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:44.668188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:44.668795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:44.675797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.676261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.676770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.677445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.677884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.678294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.763405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:44.764547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:44.771694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.772176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.772605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.773321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.773768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.774187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.812615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:44.820788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fb71e5f3-e68f-4b7f-b9ed-49fb2e4817e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156322 Aug 24 07:58:44.821374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 429/892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:44.837096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:44.845537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b8d18b3-b105-401c-a1ae-a7dd9e151431 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085993 Aug 24 07:58:44.846097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 464/893] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:45.842920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:45.843547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:45.850058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.850528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.850953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.851627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.852073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.852494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.866518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:45.867148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:45.874193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.874677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.875101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.875783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.876228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.876664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.939213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:45.947509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff188db3-7d24-4202-a198-aa29efe2b22a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084780 Aug 24 07:58:45.948080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 465/894] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:45.986038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:45.994234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-64266a7a-efdc-4684-939f-896b656eba2b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155114 Aug 24 07:58:45.994794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 430/895] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:46.969905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:46.970529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:46.976945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:46.977423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:46.977853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:46.978534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:46.978979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:46.979399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:47.016497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:47.017189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:47.023548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:47.024017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:47.024435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:47.025143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:47.025584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:47.025994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:47.042926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:47.051002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6f3f4edf-1fa5-4646-b8d5-739e4e21af02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085915 Aug 24 07:58:47.051572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 466/896] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:47.159107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:47.166760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6fdd7f0-5c30-4515-a804-3f9859a8f289 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154896 Aug 24 07:58:47.167330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 431/897] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:48.072575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:48.073223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:48.079734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.080212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.080674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.081362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.081814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.082234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.142441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:48.150150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b76a2987-dd47-42d2-9c71-2e8138b968c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081722 Aug 24 07:58:48.150725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 467/898] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:48.187442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:48.188056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:48.194548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.195015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.195445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.196119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.196991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.197262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.330297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:48.338040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-de846e97-af85-4198-b1b8-68babc06d16e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154471 Aug 24 07:58:48.338600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 432/899] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:49.172600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:49.173238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:49.179577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.180046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.180472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.181181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.181624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.182034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.243634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:49.251347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9e63a5cb-2a6f-4db6-b92f-4cab286cb879 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083744 Aug 24 07:58:49.251894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 468/900] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:49.360467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:49.361119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:49.367637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.368111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.368540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.369283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.369727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.370140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.501591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:49.509469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-93d0d09a-6aa8-42df-a1d4-d0130e0bdcc1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153042 Aug 24 07:58:49.510079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 433/901] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:50.272911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:50.273511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:50.280135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.280601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:50.281043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:50.281711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.282150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:50.282562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:50.341935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:50.349591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-180b2953-8692-4340-8bd0-567a59647b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080709 Aug 24 07:58:50.350144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 469/902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:50.531028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:50.531564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:50.537972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.538442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:50.538864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:50.539538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.539972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:50.540381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:50.542857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:50.673797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:50.681368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6a05416f-15ce-40eb-ad21-b21d3a242d12 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154403 Aug 24 07:58:50.681934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 434/903] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:51.369983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:51.370626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:51.377430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:51.377903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:51.378326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:51.379000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:51.379439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:51.379852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:51.443187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:51.452119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44345064-6848-4b68-b97d-c371ecb19fe0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085259 Aug 24 07:58:51.452705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 470/904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:51.703097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:51.703618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:51.705958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=74 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:51.710583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:51.711048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:51.711471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:51.712144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:51.712581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:51.713020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:51.843201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:51.851188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ce90bdd-0272-4417-bb86-1a4edb714906 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152002 Aug 24 07:58:51.851757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 435/905] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:52.472949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:52.473592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:52.475962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=73 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:52.480690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.481181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.481616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:52.482300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.483358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.483876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:52.545401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:52.553778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c6eab0e-8467-4bed-8b62-f83adde8ec3c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084741 Aug 24 07:58:52.554343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 471/906] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:52.872660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:52.873349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:52.879693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.880161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.880583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:52.881275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.881721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.882129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:53.015180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:53.022731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b5a61eed-2a05-4b86-a325-cc82d8b3d621 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153951 Aug 24 07:58:53.023293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 436/907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:53.575348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:53.575955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:53.582987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:53.583459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:53.583887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:53.584565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:53.585037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:53.585454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:53.645346 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:53.652955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3fc047b5-7c88-45bd-8cd9-2fc5c54b3096 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081745 Aug 24 07:58:53.653502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 472/908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:54.045597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:54.046231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:54.052617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:54.053198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:54.053624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:54.054331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:54.054783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:54.055197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:54.186587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:54.194522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b0fbb304-4cf2-4eb8-a705-5a6a8386cf77 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153607 Aug 24 07:58:54.195125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 437/909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:54.674271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:54.674801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:54.681208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:54.681682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:54.682112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:54.682791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:54.683238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:54.683653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:54.743539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:54.751918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d10d1a9-4f32-4a7a-bae3-61d6a3c70045 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081981 Aug 24 07:58:54.752480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 473/910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:55.215252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:55.215858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:55.222862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.223332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.223756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.224435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.224906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.225324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.355150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:55.363170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4eca543e-5eb4-4fd2-8695-98af7516314b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151772 Aug 24 07:58:55.363733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 438/911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:55.775594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:55.776235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:55.791128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.791128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.791128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.791128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.791541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.791541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.852018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:55.860737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d32acacb-a914-4c4e-95fd-630a0198f072 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089053 Aug 24 07:58:55.861291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 474/912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:56.383822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:56.384427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:56.391463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.391942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.392374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.393094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.393571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.393989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.527661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:56.536022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58c6189b-3856-4fed-b890-969f0d766f40 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156079 Aug 24 07:58:56.536587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 439/913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:56.881505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:56.882133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:56.889041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.889704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.890146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.890817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.891260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.891670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.955248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:56.962914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a07d893e-47fb-4c9b-8302-fd1c63baf491 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085195 Aug 24 07:58:56.963480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 475/914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:57.661307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:57.662014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:57.668253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.668864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.669323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.670091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.670618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.671035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.811099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:57.820627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8aa45ec7-4348-4d4c-9254-3dfd0aa1bbea tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.265608 Aug 24 07:58:57.821230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 440/915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:57.985738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:57.986856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:57.994329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.994806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.995230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.995913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.996359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.996850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.063452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:58.071245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7958bb1e-70b8-462f-8717-a43012a4035e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.091433 Aug 24 07:58:58.072069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 476/916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:58.843021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:58.843624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:58.850054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.850525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.850951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.851624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.852070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.852491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.984372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:58.991977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6166583a-2462-4c33-a8f8-e3a2018a9e44 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153404 Aug 24 07:58:58.992545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 441/917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:59.097461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:59.098041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:59.104380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:59.104892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:59.105319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:59.105992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:59.106431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:59.106848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:59.166408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:59.174366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0d55433e-87d8-445a-95c3-31c0f48c8106 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080758 Aug 24 07:58:59.174923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 477/918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:00.013593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:00.014193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:00.020532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.021043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.021471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.022156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.022601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.023017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.153110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.161378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-81ae1395-9758-4422-b696-29641bf8bcad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151661 Aug 24 07:59:00.161949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 442/919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:00.195124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:00.195755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:00.202634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.203095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.203518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.204188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.204629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.205075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.268299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.276037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-96a67b77-a104-4e06-8f48-22008fa2be08 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084708 Aug 24 07:59:00.276589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 478/920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:01.183192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:01.183778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:01.190694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.191162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.191589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.192261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.192734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.193143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.297215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:01.297832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:01.304302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.304811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.305250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.305972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.306452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.306877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.324035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.331867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9fea7625-f0a9-48fd-9a68-95b47d3a4563 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152459 Aug 24 07:59:01.332438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 443/921] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:01.367814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.375652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-77d55731-bb97-425c-b1e3-5d01210a4ad6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082978 Aug 24 07:59:01.376210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 479/922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:02.352786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:02.353450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:02.360927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.361405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.361837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.362549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.362997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.363466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.396877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:02.397490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:02.404624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.405145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.405573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.406268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.406716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.407136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.426079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:02.475816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:02.484529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3443a748-f648-4c0f-8824-4054a39f3a73 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.091528 Aug 24 07:59:02.485136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 480/923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:02.501976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:02.509850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-29070437-b1e8-4601-a714-6dd183285106 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.160912 Aug 24 07:59:02.510450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 444/924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:03.505853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:03.506462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:03.513014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.513617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.514049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.514726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.515172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.515587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.532613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:03.533860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:03.543945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.545500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.546217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.547308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.548038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.548755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.590349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:03.600749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0888aac9-318b-4b0b-82b1-810b25819fa1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.099099 Aug 24 07:59:03.601318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 481/925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:03.684097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:03.692528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58df92eb-fa8a-4a43-bf61-8ad8bf5a270c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.165240 Aug 24 07:59:03.693055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 445/926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:04.622083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:04.623347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:04.629697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.630173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.630601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.631283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.631730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.632155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.694324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.702800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-98f26af9-e910-4664-a4b4-ff7106a6404e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084545 Aug 24 07:59:04.703349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 482/927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:04.713490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:04.714086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:04.720554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.721068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.721489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.722161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.722601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.723043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.855532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.863367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eb1f85cd-d561-407f-9d5e-fe089439069e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153641 Aug 24 07:59:04.863928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 446/928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:05.723590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:05.724254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:05.730547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.731017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.731439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.732226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.732687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.733105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.794144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:05.802002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cd117a8b-405e-4037-a9b8-a85d2bb8f741 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082246 Aug 24 07:59:05.802557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 483/929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:05.884319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:05.884984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:05.892366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.892887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.893320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.894024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.894468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.894885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.959689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:05.960198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:05.966041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.967225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.967652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.968336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.968844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.969260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.992169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a3099faa-37f7-4d33-af16-66403608156d tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883/ips" status: 200 len: 152 microversion: 2.20 time: 0.036349 Aug 24 07:59:05.992956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 484/930] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Aug 24 07:59:05 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:59:06.025491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.033766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1c2eb428-f919-4192-bf7a-d163843dfd2f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153399 Aug 24 07:59:06.034336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 447/931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:06.823196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:06.823820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:06.830270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.830740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.831169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.831847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.832294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.832734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.892354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.899884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1962c5f0-5616-4fdb-a3fd-a0eb503feb24 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080795 Aug 24 07:59:06.900445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 485/932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:07.054755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:07.055353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:07.062006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.062469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.062893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.063564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.064005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.064416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.195541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.204538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eebda5fc-8703-4a61-bcd3-d067d6a5aedf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153618 Aug 24 07:59:07.205163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 448/933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:07.921511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:07.922117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:07.928515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.929026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.929462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.930149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.930601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.931024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.990833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.999189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0ed542a9-612c-486e-a34a-4bfadc86ba60 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081388 Aug 24 07:59:07.999757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 486/934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:08.225633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:08.226189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:08.232625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.233889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.234303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.234983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.235420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.235831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.366437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:08.374980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-34545f56-f5d9-46f1-8b64-ece600eef8d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153289 Aug 24 07:59:08.375539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 449/935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:09.117113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:09.117725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:09.123521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:09.123997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:09.124428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:09.125795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:09.126247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:09.126669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:09.189100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:09.197049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1c77de1f-dabe-4a62-a2f4-21a0f022ac43 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.180505 Aug 24 07:59:09.197609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 487/936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:09.395918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:09.396558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:09.402976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:09.403449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:09.403881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:09.404558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:09.405037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:09.405456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:09.536163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:09.538547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:09.544664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-75e55c45-5e90-472f-bb8a-72d32906b017 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152528 Aug 24 07:59:09.545235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 450/937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:10.217410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:10.218020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:10.225295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.225775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.226205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.226885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.227332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.227754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.289637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.297296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9a753dae-f7a0-491c-9a7d-3681e04e4beb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083720 Aug 24 07:59:10.297884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 488/938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:10.566707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:10.567347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:10.574534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.575009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.575445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.576129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.576577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.577022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.711517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.719410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2def770b-e7db-42b5-b894-d337882b651c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157175 Aug 24 07:59:10.719978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 451/939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:10.724237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:10.724794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:10.730661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.731133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.731564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.732245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.732714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.733133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.755826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6f4e494a-b41e-483e-8000-41f4cda56796 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d/ips" status: 200 len: 151 microversion: 2.1 time: 0.035383 Aug 24 07:59:10.759906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 489/940] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 07:59:10 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:59:11.318725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:11.319321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:11.325738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.326214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.326640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.327316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.327788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.328324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.388325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.396224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ad9579ee-399b-4f1e-9b41-297f810f4410 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081319 Aug 24 07:59:11.396811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 452/941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:11.739485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:11.740028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:11.746494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.750598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.750598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.750598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.750598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.751018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.877671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.885353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ebc57bd-993c-4aff-ad86-4be9c51159e1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149787 Aug 24 07:59:11.885917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 490/942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:12.417621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:12.418221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:12.425456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.425928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.426353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.427223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.427690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.428089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.488577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:12.496131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e4ae9bbe-d2a4-48a1-8e63-b42dba732ab8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082369 Aug 24 07:59:12.496711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 453/943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:12.907111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:12.907851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:12.914316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.914796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.915232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.915915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.916437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.916893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.049038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.056743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-81e0c48a-82b9-4138-9c2e-1ca3ccc7e286 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153490 Aug 24 07:59:13.057294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 491/944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:13.517706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:13.518383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:13.525546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.526016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.526467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.527155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.527591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.528009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.591467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.599209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76ffbb8c-03aa-41de-8d70-2083006e3333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085276 Aug 24 07:59:13.599771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 454/945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:14.078592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:14.079176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:14.085798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.086270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.086693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.087368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.087811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.088232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.218458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:14.226298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7bb782c9-8351-4299-8c1d-2a8a69916bdb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151647 Aug 24 07:59:14.226859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 492/946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:14.619311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:14.620061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:14.626553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.627050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.628247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.628972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.629423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.629870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.689415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:14.697707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f28a7823-7115-452a-a4ed-f3cbb82ff4c0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082286 Aug 24 07:59:14.698278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 455/947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:15.247309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:15.247927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:15.255055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:15.255527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:15.255955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:15.256662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:15.257109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:15.257525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:15.388365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:15.396720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7cbe8c2d-fe2f-4c52-9ad7-5b2b915c7718 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153262 Aug 24 07:59:15.397285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 493/948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:15.718950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:15.719473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:15.726146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:15.726617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:15.727043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:15.727718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:15.728162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:15.728581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:15.788666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:15.796201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-63ff958d-8f1a-4ef7-ba88-ea96bde6aa5e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081151 Aug 24 07:59:15.796794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 456/949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:16.418271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:16.418870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:16.426233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.426701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.427128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.427795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.428234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.428667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.562859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.570603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d80b0e1c-0d25-448a-b6ee-acaf38f592d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156341 Aug 24 07:59:16.571421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 494/950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:16.816969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:16.817580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:16.824233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.824741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.825171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.825853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.826297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.826716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.886788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.894336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-69d7a2fc-0c8d-4c44-93a0-f1ab50d7b17b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081965 Aug 24 07:59:16.894899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 457/951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:17.591376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:17.592439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:17.599023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.599529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.599987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.600708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.601164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.601590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.732664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.741174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5e083c18-13ed-4202-ac53-439a00ec0b1f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153728 Aug 24 07:59:17.741739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 495/952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:17.914462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:17.915087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:17.921613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.922080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.922508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.923174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.923614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.924085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.990733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.998427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2dbf8c25-da9d-43f3-874f-0e497652af2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087836 Aug 24 07:59:17.998991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 458/953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:18.762940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:18.763551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:18.770747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.771225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.771665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.772413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.772895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.773322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.905496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:18.913332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b3950d8-70dc-41c8-a39f-3c3f0e484169 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154275 Aug 24 07:59:18.913900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 496/954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:19.019400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:19.019993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:19.026312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.026778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.027200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.027868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.028330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.028767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.089753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:19.098224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2625b564-ab3d-40d5-b3d4-1c81427e55bc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082609 Aug 24 07:59:19.098782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 459/955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:19.934479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:19.935072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:19.941842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.942312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.942738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.943416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.943858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.944271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.075072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.078486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:20.083380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fef42ecd-74bf-44b9-8699-dcdf83ac537c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152864 Aug 24 07:59:20.083943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 497/956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:20.118972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:20.119579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:20.125957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.127863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.127863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.128138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.128517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.128963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.188765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.197557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e45483de-f7f1-4ab0-a9e3-cf61c4a3bb29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082760 Aug 24 07:59:20.198123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 460/957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:21.104660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:21.105298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:21.112734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.113216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.113649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.114331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.114784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.115205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.218727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:21.219335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:21.226028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.226508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.226961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.227643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.228090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.228506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.247389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:21.255574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab9f0194-ed4e-410a-ad1e-2ec0c380c8d8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155081 Aug 24 07:59:21.256130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 498/958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:21.289983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:21.297828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b3f1f598-97f0-437c-afd4-e2d34dc43971 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082927 Aug 24 07:59:21.298396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 461/959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:22.278065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:22.278605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:22.285306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.285774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.286196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.286865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.287302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.287712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.319706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:22.320301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:22.322850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=54 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:22.327535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.328002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.328426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.329128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.329569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.329980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.395378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:22.403019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84f4ef25-e37a-46b6-a351-8051c09a30a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087202 Aug 24 07:59:22.403580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 462/960] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:22.420614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:22.428819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-202598cc-de9f-42e9-a9e1-5c0d01a2bb14 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154740 Aug 24 07:59:22.429378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 499/961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:23.424528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:23.425388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:23.431784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.432250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.432690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.433363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.433801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.434216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.450424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:23.451036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:23.453433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=58 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:23.458375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.458863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.459305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.460004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.460456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.461000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.495923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:23.503771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e0bfc3c-e20a-4b0b-9067-04834501113d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083695 Aug 24 07:59:23.504343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 463/962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:23.594104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:23.602788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c448f051-0c79-4239-bad0-fd1f7830333e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156610 Aug 24 07:59:23.603359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 500/963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:24.524807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:24.525391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:24.531845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.532624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.532764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.533449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.533900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.534304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.596552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:24.604135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-efdd4e5e-574f-4994-a111-d847913ae6c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083191 Aug 24 07:59:24.604707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 464/964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:24.629298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:24.629904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:24.636269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.636780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.637208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.637888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.638326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.638737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.770745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:24.778621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-337e105a-1513-4039-8793-16488dd7f66c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154093 Aug 24 07:59:24.779116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 501/965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:25.625290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:25.625883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:25.632837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.633307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.633730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.634394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.634829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.635238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.696435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:25.704071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-34ac5000-e0cc-4b06-a71d-28c7b863654a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082543 Aug 24 07:59:25.704626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 465/966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:25.800305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:25.801205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:25.807752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.808226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.808747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.809438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.809914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.810302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.940165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:25.948138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3a8215cc-17c8-4ad2-8c92-b9d90e63078e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152427 Aug 24 07:59:25.948639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 502/967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:26.724973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:26.725570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:26.731922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.732391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.732846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:26.733514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.733959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.734367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:26.798401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:26.806555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ca80f49e-b052-4964-9a52-3fd77077d947 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086119 Aug 24 07:59:26.807121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 466/968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:26.968894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:26.969507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:26.978997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.979481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.979943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:26.980804 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.981272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.981692 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.114150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:27.121970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ba4d2202-3198-4bbd-ad73-11881e74843a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156978 Aug 24 07:59:27.122522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 503/969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:27.827525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:27.828152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:27.834903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.835369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.835792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.836495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.836960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.837370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.852089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:27.898704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:27.906464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fbdc96f3-6448-4c20-9c4a-ea9679d19031 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082782 Aug 24 07:59:27.907036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 467/970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:28.143556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:28.144169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:28.150331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.155791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.155791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.155791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.155791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.156226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.282366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:28.290868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ea68d5df-350e-4f7a-9d97-e93631734820 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151381 Aug 24 07:59:28.291432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 504/971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:28.927710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:28.928354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:28.934886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.935376 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.935838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.936529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.937009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.937435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.998891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:29.006530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-350a2601-a22c-41c1-bebb-c97e358ba555 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082983 Aug 24 07:59:29.007106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 468/972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:29.311335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:29.311941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:29.319072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.319579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.320015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.321009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.321489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.321906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.448091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:29.455926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-37f5d0d9-e242-4816-9a1b-0ba211a4e86c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.148542 Aug 24 07:59:29.456503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 505/973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:30.027218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:30.033997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:30.034224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.034693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.035120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.035788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.036226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.036638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.097444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:30.105121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf2c2abb-83d4-4b48-859a-82529aaf1340 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081795 Aug 24 07:59:30.105676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 469/974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:30.477898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:30.478510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:30.484957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.485431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.485860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.486570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.487018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.487433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.621642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:30.629308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d04b912e-8f33-4606-8c67-a9bfac5e54f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155283 Aug 24 07:59:30.629899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 506/975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:31.126123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:31.126699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:31.133812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.134283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.134706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.135382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.135823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.136231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.200612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:31.208580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-66b2828b-2221-4376-882e-86d7beb55ce7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086236 Aug 24 07:59:31.209174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 470/976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:31.651337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:31.652096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:31.658589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.659060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.659486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.660799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.661239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.661652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.791383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:31.799252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf65c710-5ea8-44e8-aa4c-370ccb71753d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151742 Aug 24 07:59:31.799823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 507/977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:32.229495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:32.230102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:32.236467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.236971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.237400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.238732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.239175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.239604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.302002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:32.310516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ff864fdc-bc87-4f38-9450-d0215d32d458 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084798 Aug 24 07:59:32.314791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 471/978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:32.821497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:32.822111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:32.828488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.828997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.829428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.830134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.830580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.831044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.962596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:32.970291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3c3de91c-de77-465c-99f1-0fdf4578a7e4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152940 Aug 24 07:59:32.970854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 508/979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:33.331873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:33.332469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:33.338802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.339267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.339691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.340360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.340835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.341250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.400995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:33.408534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bda41bb8-fc64-4e0f-949f-ceaca4531aec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080595 Aug 24 07:59:33.409123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 472/980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:33.991109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:33.991776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:33.998236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.998713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.999142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.999827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.000273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.000719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.133638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:34.141377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-47673dfb-304b-42df-910a-74d55c3676bd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154912 Aug 24 07:59:34.141939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 509/981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:34.429470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:34.430079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:34.436525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.437034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.437466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.438169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.438618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.439062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.500589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:34.508820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6c8eb287-850f-46d9-aa95-ca6047f94f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083395 Aug 24 07:59:34.509372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 473/982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:35.163153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:35.163875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:35.170304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.170714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.171137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.171810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.172250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.172747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.309110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:35.317041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b33a35fb-9a57-44bb-8148-f7472517104c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158792 Aug 24 07:59:35.317607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 510/983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:35.530724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:35.531528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:35.538129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.538597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.539021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.539699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.540136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.540545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.603841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:35.611556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96c603c3-0ee0-47a1-a26d-cfe851d5058d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084691 Aug 24 07:59:35.612111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 474/984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:36.339025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:36.339691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:36.346061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.346533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.346961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.348495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.348972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.349389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.480274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:36.488596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-49df1e64-a608-4928-8480-d86989813b3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153368 Aug 24 07:59:36.489239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 511/985] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:36.632953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:36.633527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:36.639925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.640391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.640848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.641520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.641957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.642366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.703137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:36.711422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b5e63aad-7605-4bac-8d5f-d6a9dbf70e09 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083041 Aug 24 07:59:36.711981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 475/986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:37.510018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:37.510659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:37.517162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.517644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.518077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.519596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.520083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.520508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.651054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:37.658837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-32bc587f-039e-4993-ab9a-b1f0ad433af5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152713 Aug 24 07:59:37.659426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 512/987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:37.732388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:37.732980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:37.739692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.740161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.740577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.741276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.741716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.742126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.803784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:37.811516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9092df49-e7e6-4ff6-a984-8c731cd21daa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082947 Aug 24 07:59:37.812076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 476/988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:38.680455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:38.681102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:38.687576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.688087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.688526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.689239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.689690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.690109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.823736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:38.832224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9583c26e-ac50-482b-bebf-d1ac9ef8e3f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154843 Aug 24 07:59:38.832820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 513/989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:38.837379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:38.837990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:38.844320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.844836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.845271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.845961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.846410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.847490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.909938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:38.917716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4966b87f-3f2a-4acc-b065-f96c37674685 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088867 Aug 24 07:59:38.918284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 477/990] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:39.852747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:39.853358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:39.859694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.860142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.860562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.861256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.861697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.862107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.880388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:39.938436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:39.939039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:39.946343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.946815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.947239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.947921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.948366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.948809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.993624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:40.001464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-54fc47f8-c0d7-4a28-85d6-2440ae71d2b2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152593 Aug 24 07:59:40.002041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 514/991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:40.014025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:40.022798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-895d6f96-b5e4-401e-ad2d-2e414b2ff433 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088148 Aug 24 07:59:40.023369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 478/992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:41.024260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:41.024897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:41.031373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.031844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.032272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.032973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.033417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.033828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.043167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:41.043776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:41.051213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.051694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.052122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.052837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.053287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.053705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.114866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:41.122767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1c7aaa7a-24a9-49d1-9b4f-6d2de9591b26 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083424 Aug 24 07:59:41.123337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 479/993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:41.171055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:41.178911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78148f22-e5a8-4ff4-9e02-525671ebce67 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158561 Aug 24 07:59:41.179478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 515/994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:42.143298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:42.144750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:42.150903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.151425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.151855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.152521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.152989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.153402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.199721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:42.200334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:42.207589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.208083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.208518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.209244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.209704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.210126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.215370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:42.222971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-903b1b69-72b7-4bac-8f21-4c43dce4ef90 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083504 Aug 24 07:59:42.223530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 480/995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:42.339393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:42.349355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8e62f556-035a-4211-b711-d20a2850f944 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153721 Aug 24 07:59:42.349929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 516/996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:43.243710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:43.244313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:43.250770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.251247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.251678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.252363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.252872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.253471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.313482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:43.321559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-19ebc9e8-0104-4064-9bd4-8f51bb8e173f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081726 Aug 24 07:59:43.322148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 481/997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:43.370147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:43.370757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:43.377120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.377594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.378729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.379416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.379859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.380292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.510835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:43.518509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b9e6f95-307e-4c19-8b9e-4e71c2614290 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152164 Aug 24 07:59:43.519244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 517/998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:44.341712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:44.342310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:44.349491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.349963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.350391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.351064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.351512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.351922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.415423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:44.423136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ff099e0c-b9e8-4055-b3ec-27918d95c907 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085265 Aug 24 07:59:44.423690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 482/999] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:44.538458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:44.539056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:44.545808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.546277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.546700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.547369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.547809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.548220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.683523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:44.691899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-05268a41-52b4-46c1-a100-96a8bfdb836f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157295 Aug 24 07:59:44.692456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 518/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:45.445030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:45.445933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:45.452414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.452921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.453354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.454041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.454489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.454906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.515180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:45.522931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a11ca643-4cac-4e4a-b612-d2e0b7d219ec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082413 Aug 24 07:59:45.523469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 483/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:45.712905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:45.713431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:45.719887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.720365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.720837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.722081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.722811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.723218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.853300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:45.861056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f487353b-91b7-4468-9b04-65d96346d376 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152047 Aug 24 07:59:45.861607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 519/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:46.543294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:46.543892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:46.551176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.551643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.552171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.552880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.553322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.553735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.557567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:46.618050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:46.625776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1d62331e-732d-4299-b36a-369b9db67a16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086276 Aug 24 07:59:46.626346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 484/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:46.883152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:46.883763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:46.890169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.890724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.891153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.891831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.892274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.892709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.023654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:47.031537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-277387f2-3508-450b-a047-e90d3ab14659 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152246 Aug 24 07:59:47.032111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 520/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:47.647434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:47.648074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:47.654569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.655037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.655464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.656162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.656606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.657039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.868917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:47.876424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a4d26427-b144-43d2-9850-5fc328c2f552 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.233802 Aug 24 07:59:47.877016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 485/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:48.054288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:48.054955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:48.061286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.061757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.062186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.062867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.063305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.063716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.195771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:48.204604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84b1b589-7a74-4cd1-9441-47fa50ffafda tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155920 Aug 24 07:59:48.205193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 521/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:48.898380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:48.898977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:48.905261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.905735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.906153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.906818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.907257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.907666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.971796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:48.979604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bad41f2b-1691-4bda-ae85-12da84e16f3e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085228 Aug 24 07:59:48.980154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 486/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:49.226361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:49.226890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:49.233317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:49.233791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:49.234216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:49.234892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:49.235338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:49.235755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:49.370525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:49.378296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-985abded-d138-45d6-a46d-518f03d7aa0d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156269 Aug 24 07:59:49.378863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 522/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:50.000416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:50.001030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:50.008231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.008730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.009152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.009819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.010254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.010662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.070102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:50.077938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e739e096-d91a-4751-8fe5-742b950988e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081335 Aug 24 07:59:50.078485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 487/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:50.400180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:50.400821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:50.408193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.411435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.411435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.411435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.411435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.411910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.541253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:50.549001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e3ea1c7-524f-4029-bf3a-83fd3b603181 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152911 Aug 24 07:59:50.549657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 523/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:51.099261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:51.099858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.106202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.106669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.107088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.107751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.108188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.108596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.168192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:51.176073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ea0f2f78-34a3-41ff-b2b0-d290894aba0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081023 Aug 24 07:59:51.176630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 488/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:51.569847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:51.570728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.577320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.577827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.578264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.578959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.579428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.579851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.709672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:51.717484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-abbb51cc-f7d5-43b0-9a98-2ff593398ef5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152103 Aug 24 07:59:51.718062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 524/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:52.197653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:52.198290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.204600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.205102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.205529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.206279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.206714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.207128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.266469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:52.274227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-936ceb9b-6dd2-490c-bf33-bb85c775605d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080610 Aug 24 07:59:52.274793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 489/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:52.739936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:52.740575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.747208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.747687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.748118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.748847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.749299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.749720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.883514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:52.891215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8695830c-9a6a-48be-989d-ebbd8b11d68e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156115 Aug 24 07:59:52.891779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 525/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:53.295274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:53.295814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:53.298094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=56 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:53.303591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.304067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.304487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.305200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.305643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.306058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.369350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:53.376892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7662b73f-d586-40f7-a75e-1a5416e7bccc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085588 Aug 24 07:59:53.377454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 490/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:53.913746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:53.914350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:53.916691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=52 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:53.921333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.921802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.922227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.922895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.923337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.923747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.055119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:54.062957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5006f78f-ab96-49f6-96be-6a8d96f0ac18 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153195 Aug 24 07:59:54.063518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 526/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:54.398227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:54.398852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:54.405394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.405869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.406294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.406975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.407420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.407838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.470813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:54.478368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-685606e2-f720-438c-b0d4-3617de61fd71 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084096 Aug 24 07:59:54.478933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 491/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:55.083876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:55.084491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:55.091111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:55.091588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:55.092019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.092729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:55.093183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:55.093604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.225703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.233555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c5dc579-b51b-455e-8d91-6d9cb4d8f577 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154118 Aug 24 07:59:55.234126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 527/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:55.499267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:55.499869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:55.507041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:55.507519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:55.507942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.508615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:55.509080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:55.509492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.569973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.577778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1b1bfc11-4209-4fcd-bd3a-429c2405da75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082295 Aug 24 07:59:55.578334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 492/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:56.254880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:56.255489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:56.261921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.262396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.262825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.263505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.263951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.264366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.393424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.401502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b26870ad-d58a-4c92-9257-a7472ce5396a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151014 Aug 24 07:59:56.402060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 528/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:56.599990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:56.600593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:56.607123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.607597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.608023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.608731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.609179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.609597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.669496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.677127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-aebbc30f-a905-4e06-b762-04ae7dce0f9a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081678 Aug 24 07:59:56.677694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 493/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:57.423114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:57.423671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:57.430534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.431018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.431439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.432113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.432551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.433001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.568388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.576457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8881d097-526e-4733-b3ea-165dbc7d33f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157234 Aug 24 07:59:57.577065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 529/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:57.698523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:57.699100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:57.706154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.706814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.707250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.707934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.708378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.708825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.771952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.779773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bde2398b-94bc-43b0-b0b9-59d6a7f63e5f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085381 Aug 24 07:59:57.790081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 494/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:58.597745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:58.598348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:58.604674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.605161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.605586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.606279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.606701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.607112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.739050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.746661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d9326a2a-89b0-4de0-8e77-9c24e9ae9904 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153189 Aug 24 07:59:58.747223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 530/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:58.800596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:58.801140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:58.807822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.808385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.808841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.809519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.809960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.810371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.870579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.878774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-11128ab3-4229-4970-8cea-ce577a7d8f7d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082816 Aug 24 07:59:58.879338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 495/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:59.767777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:59.769318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:59.775915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.776546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.778389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.779079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.779568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.780010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.784831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:59.900627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:59.901259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:59.907668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.908154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.909197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.910023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.910480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.910907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.929722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:59.937782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bcb7e322-0cad-4afc-9fa1-541914cd8882 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.174131 Aug 24 07:59:59.938369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 531/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:59.974484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:59.982322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-527b35cf-d240-4220-ae0f-7d7d91c68be3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086318 Aug 24 07:59:59.982891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 496/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:00.962582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:00.963186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:00.969677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:00.970165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:00.970570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:00.971777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:00.972222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:00.972636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.004289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:01.004921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:01.011495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.012601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.013056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.013753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.014200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.014625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.079389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:01.087659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a79c96ea-abd5-4bf9-bc4a-5c8f78ca11d8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087711 Aug 24 08:00:01.088226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 497/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:01.106611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:01.114362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d45e705-0846-48b9-b97c-9cc853f5a7fd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155689 Aug 24 08:00:01.114928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 532/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:02.109039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:02.109641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:02.116287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.116879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.117309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.118012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.118462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.118878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.135179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:02.136050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:02.142478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.143563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.144320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.145106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.145661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.146146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.191267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:02.194031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a15caba5-7887-4e23-bc09-d033fdc476c6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088839 Aug 24 08:00:02.195398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 498/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:02.279685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:02.288070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-15b822c8-5680-4297-8dc2-f1c040d2c11e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156995 Aug 24 08:00:02.288659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 533/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:03.216685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:03.217292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:03.224530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.225032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.225462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:03.226139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.226587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.227000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:03.287502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:03.295455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d27db46e-e85d-4d99-ba76-366d91f6b319 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082617 Aug 24 08:00:03.296017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 499/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:03.310675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:03.311282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:03.318065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.318535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.318956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:03.319624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.320321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.320760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:03.451474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:03.459992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c845d8c3-5d76-4ea1-a0b5-025929bce7ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153248 Aug 24 08:00:03.460558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 534/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:04.317205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:04.317799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:04.324753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:04.325229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:04.325652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:04.326333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:04.326770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:04.327182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:04.389023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:04.391125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:04.397877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-835b08f6-fa2a-4082-91ff-229d01f05a51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085190 Aug 24 08:00:04.398442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 500/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:04.481717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:04.482316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:04.489614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:04.490095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:04.490525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:04.491244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:04.491691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:04.492111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:04.624790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:04.633228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-96ae3853-cf71-4126-b053-e36452ecbb4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155328 Aug 24 08:00:04.636107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 535/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:05.419267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:05.419872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:05.427643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.428117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.428545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.429256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.429704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.430123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.490409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:05.498097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4a4be390-c937-436a-bfb5-781242b83ca2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082687 Aug 24 08:00:05.498656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 501/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:05.654866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:05.655473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:05.662778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.663249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.663677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.664350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.664830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.665334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.794042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:05.802468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4af4215-6de3-4a1b-9144-a41fe2277d5c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151426 Aug 24 08:00:05.803052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 536/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:06.080334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.080848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.086896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.087358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.087779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.088449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.088914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.089326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.114060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:00:06.379038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e9b6fc6c-b999-4916-b9cd-b4c4072d2891 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 204 len: 0 microversion: 2.20 time: 0.302155 Aug 24 08:00:06.379561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 502/1038] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 24 08:00:06 2022] DELETE /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:00:06.387984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.388593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.395162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.395641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.396087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.396807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.397267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.397689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.519640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.520329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.526693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.527172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.527599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.528306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.528764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.529187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.533127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.543407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.545001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.546229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f09e9d1d-48dd-4e0a-9ae0-a97a65a9839a tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1725 microversion: 2.20 time: 0.162309 Aug 24 08:00:06.546786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 537/1039] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:06 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:06.596346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.604353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d24ab182-a6d4-4503-af6b-718b87efd3bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089411 Aug 24 08:00:06.604945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 503/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:06.824149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.824815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.831106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.831573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.831998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.832688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.833133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.833544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.963002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.970626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-664bc220-5fc3-46c9-b2b2-01cfab06f5d4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150633 Aug 24 08:00:06.971196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 538/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:07.570634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:07.571244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:07.577709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.578188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.578625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.579482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.579942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.580415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.624894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:07.625503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:07.631777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.632253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.632718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.633409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.633863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.634284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.696584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.704363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ce3fb96-2c6b-4ef7-ad71-234bb739cad7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083321 Aug 24 08:00:07.707104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 539/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:07.716895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.725729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.727154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.728304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5978a668-9d1c-4e28-8018-81600eeabcad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1725 microversion: 2.20 time: 0.162004 Aug 24 08:00:07.728896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 504/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:07 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:07.993146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:07.993673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:07.999996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.000471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.000932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.001612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.002765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.003505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.458972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.468085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-238d7816-9ecf-4b69-9a4f-aeed7da9ad5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.478881 Aug 24 08:00:08.480736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 540/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:08.729823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:08.729823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:08.733213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.733687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.734114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.734797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.735243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.735658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.753627 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:08.755116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:08.761729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.762214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.762764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.763469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.763922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.764580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.802408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.819345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-289e385e-74df-4608-9243-a301d6107092 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.097026 Aug 24 08:00:08.821241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 505/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:08.842681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.852420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.855756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.855756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c02ab90-2dc9-449e-b895-da409bcc0412 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1657 microversion: 2.20 time: 0.107969 Aug 24 08:00:08.856331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 541/1046] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:08 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:09.013478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0e3ad6-3c71-43d7-921a-b1799ac33883", "name": "network-vif-deleted", "tag": "bd11c2f6-baab-4212-9ebb-6dce218ba73a"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:09.023693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.024389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.024903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.037170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] Creating event network-vif-deleted:bd11c2f6-baab-4212-9ebb-6dce218ba73a for instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 on hv-cinder-85427 Aug 24 08:00:09.044268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-519d911b-3e21-4731-b5af-bd496cffb48e req-3e360102-e8f9-48fc-98f3-6f6d3af2a05e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Aug 24 08:00:09.044916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 506/1047] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:09.489335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:09.489976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:09.496393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.496924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.497353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.498030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.498470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.498881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.633582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.641462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d35de3f3-7801-4e39-b72c-60544700d6e7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156095 Aug 24 08:00:09.642022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 542/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:09.841806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:09.842508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:09.849599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.850085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.850529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.851258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.851711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.852131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.879619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:09.884279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:09.890669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.891433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.892076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.892860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.893392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.893723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.918339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.927187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.927432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dcdacc98-4f26-4e65-a2cd-7c47818558c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090309 Aug 24 08:00:09.927904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.928366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 507/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:09.931710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.932398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lazy-loading 'fault' on Instance uuid 0e0e3ad6-3c71-43d7-921a-b1799ac33883 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:09.976083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.982718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.984216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.985390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-20f67d7e-cb7b-4e92-b898-27e9eae024f3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 200 len: 1372 microversion: 2.20 time: 0.109783 Aug 24 08:00:09.985947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 543/1050] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:09 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:10.663168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:10.663826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:10.669728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.673265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.673265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.673265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.673265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.673642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.806745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:10.814450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3a7cbdac-87c0-46f8-ac8e-22c47b1de8ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156067 Aug 24 08:00:10.815331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 508/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:10.831846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:10.834048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:10.839160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.839643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.840076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.840848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.841303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.841727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.869769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:00:10.949302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:10.949931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:10.956767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.957248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.957823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.958628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.959079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.959496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.024473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.032339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ab01a87c-218e-4e8e-888a-53c73f78055f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087778 Aug 24 08:00:11.033453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 509/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:11.038096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.039072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:11.044958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.045632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.046221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.047137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.047590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.048010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.062117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 HTTP/1.1 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:00:11.064066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:00:11.067366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '0e0e3ad6-3c71-43d7-921a-b1799ac33883'} Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:11.068430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:00:11.070377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:11.071766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:11.071766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e7447103-d56d-4e1c-a7f9-e01c08e8ebc4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 404 len: 111 microversion: 2.20 time: 0.031480 Aug 24 08:00:11.071766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 510/1053] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:11 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:00:11.075104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0dc7fd27-ded3-40c2-b93d-b97718141064 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '.version_select at 0x7f456b720ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.080875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dc7fd27-ded3-40c2-b93d-b97718141064 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:00:11.181991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d961f56d-d2e7-458c-b253-412a5b51c90f tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 204 len: 0 microversion: 2.1 time: 0.354531 Aug 24 08:00:11.182705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 544/1054] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:00:10 2022] DELETE /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:00:11.191604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.192304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:11.198564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.199027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.199461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.200149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.200593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.201041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.331626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.335120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:11.339706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca047fce-0f8a-496c-94a9-ee446c466f84 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1683 microversion: 2.1 time: 0.152631 Aug 24 08:00:11.340268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 545/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:11 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:11.836116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.836797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:11.843411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.843884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.844316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.845033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.845481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.846636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.980547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.988894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f62101a7-1599-4cb5-aaaf-edb5bebd1b19 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156900 Aug 24 08:00:11.989466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 546/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:12.053558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:12.054188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:12.059990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.060544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.061009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.061690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.062165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.062583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.086897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dc7fd27-ded3-40c2-b93d-b97718141064 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55926. Aug 24 08:00:12.122920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.130663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7f0f818-1172-4e55-b730-088735f58833 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081553 Aug 24 08:00:12.131226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 547/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:12.178357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0dc7fd27-ded3-40c2-b93d-b97718141064 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357402231" status: 204 len: 0 microversion: 2.20 time: 1.106754 Aug 24 08:00:12.178938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 511/1058] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Aug 24 08:00:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357402231 => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 08:00:12.360756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:12.361820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:12.367832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.368313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.368796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.369492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.369942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.370493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.582059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.593699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-472f29ac-2cf4-4a46-9d46-9183e0986037 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1683 microversion: 2.1 time: 0.236864 Aug 24 08:00:12.594277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 548/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:12 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:12.986849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-46db28a8-ec50-4b97-8e35-a96d615647a1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Action: 'create', calling method: .version_select at 0x7f456b700430>, body: {"keypair": {"name": "tempest-keypair-581664317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3t82+lOehgo+NkMtOhHXTdY7SA9z8mX3o5Pycv4ZFcJKhfKrbjOsc1BO++X8kmjpP/8eA6k3qjG8Me5QzH7DtbgliuIeHll1JXW/e9IUJnDu8MgR6dDHhfVxT0pSD8Ow=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:13.004112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-46db28a8-ec50-4b97-8e35-a96d615647a1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:00:13.008250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-46db28a8-ec50-4b97-8e35-a96d615647a1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for user 1858e633724d446dbbd128b317158d3f and project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:00:13.010950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:13.011608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:13.019605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.020300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.026450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.026450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.026450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.026450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.108907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-46db28a8-ec50-4b97-8e35-a96d615647a1 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126189 Aug 24 08:00:13.116685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 512/1060] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Aug 24 08:00:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 08:00:13.151633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:13.152159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:13.158395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.158874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.159477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.160163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.160668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.167120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.208022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.216693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46225c1c-1cd3-4ea4-8211-2073c2e83a10 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.209937 Aug 24 08:00:13.217514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 549/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:13.225397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.233414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2372e1cc-2a9e-4522-ab98-6cdf23afe1d2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085933 Aug 24 08:00:13.233993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 513/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:13.615717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:13.616464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:13.620890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784c3d15-1dbe-418f-a7e4-dfb43cbc784d", "name": "network-vif-deleted", "tag": "a76bdc8f-0427-48b3-bd6d-69ed31bfbbca"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:13.624068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.624633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.625191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.625968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.626785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.627396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.630937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.631493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.632896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.646562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] Creating event network-vif-deleted:a76bdc8f-0427-48b3-bd6d-69ed31bfbbca for instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d on hv-cinder-85427 Aug 24 08:00:13.652351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-6961ad5b-8b61-4238-9cb0-2250999ae7db req-886edd4c-6cef-4d34-9604-67828f191869 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 Aug 24 08:00:13.652987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 514/1063] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:13.699966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee01beeba5b48c3b6c25489743de40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7ef4f035fd402fb7e21a21c40e7c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.707510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56c626ed-5200-4a48-ad96-ec6cb9e4e762 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 200 len: 1615 microversion: 2.1 time: 0.096603 Aug 24 08:00:13.708264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 550/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:13 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:14.239456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.240114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:14.246415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.246891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.247317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.248099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.248544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.248984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.262185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.263386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:14.276415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.276930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.277398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.278108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.278561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.278985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.382633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:14.391646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5d2b1b96-6d62-4953-9090-00e7cf68d45d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.135664 Aug 24 08:00:14.392222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 551/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:14.408368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:14.416381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-517472df-7e2c-497c-aeda-c80b792d9f70 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.181690 Aug 24 08:00:14.416994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 515/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:14.728283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.729009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:14.735157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.735636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.736806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.737704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.738139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.738558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.753638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d HTTP/1.1 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:00:14.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:14.757303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '784c3d15-1dbe-418f-a7e4-dfb43cbc784d'} Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:14.758277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:14.759762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:00:14.761881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:14.762728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-539c7eaf-ad3d-48a7-a018-277bd1eda7c2 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 404 len: 111 microversion: 2.1 time: 0.038424 Aug 24 08:00:14.763278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 552/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:14 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:14.774208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6323f7d6-6176-4858-b0f1-ad33be122e32 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '.version_select at 0x7f456b699040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.874563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6323f7d6-6176-4858-b0f1-ad33be122e32 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724849615" status: 202 len: 0 microversion: 2.1 time: 0.105722 Aug 24 08:00:14.875180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 516/1068] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Aug 24 08:00:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724849615 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:00:15.413706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:15.415073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:15.422283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.422955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.423782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.424989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.425632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.426223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.450102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:15.452788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:15.459335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.459814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.460244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.460998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.461444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.461862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.508422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.516523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ece76080-7908-42bf-a184-a9fd56716530 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.106657 Aug 24 08:00:15.517711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 553/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:15.583403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1383158134", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb4008a5-4c52-487f-81ff-7eac3538fa6d"}], "security_groups": [{"name": "tempest-securitygroup--1137187690"}], "key_name": "tempest-keypair-581664317", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:15.607865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.615728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4446363e-094d-464e-be18-eea8d33de60a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.175058 Aug 24 08:00:15.616409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 517/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:15.755154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] validate_networks() for [('eb4008a5-4c52-487f-81ff-7eac3538fa6d', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:00:15.787627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:15.788129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:15.794161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.794568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.795001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.795680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.796120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.796536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.810239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d HTTP/1.1 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:00:15.811890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.813480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '784c3d15-1dbe-418f-a7e4-dfb43cbc784d'} Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:15.814988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.816355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.817891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:15.817891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ea40c03-f05e-4d61-8191-f88485c561e6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 404 len: 111 microversion: 2.1 time: 0.030029 Aug 24 08:00:15.817891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 518/1071] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:00:15 2022] DELETE /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:15.822392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:15.822983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 784c3d15-1dbe-418f-a7e4-dfb43cbc784d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:15.828748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.829221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.829643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.831374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.831829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.832245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.845388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d HTTP/1.1 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:00:15.847276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.848832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '784c3d15-1dbe-418f-a7e4-dfb43cbc784d'} Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:15.849630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. Aug 24 08:00:15.851315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:00:15.852932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 784c3d15-1dbe-418f-a7e4-dfb43cbc784d could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:15.852932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ed45b3fc-f6c2-4577-a5ce-94fa52ee501e tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d" status: 404 len: 111 microversion: 2.1 time: 0.030020 Aug 24 08:00:15.852932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 519/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:15 2022] GET /compute/v2.1/servers/784c3d15-1dbe-418f-a7e4-dfb43cbc784d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:00:16.195046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:00:16.195471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:00:16.195941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:00:16.196383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:00:16.196833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:00:16.206433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.206918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.207345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.208070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.208522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.208966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.226306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:00:16.230347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Getting quotas for user 1858e633724d446dbbd128b317158d3f and project 7f4908cc2cf74047bcd5cc1771b28189. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:00:16.241579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:00:16.243870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:00:16.386193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c5e3f79-aa5c-44cc-9c74-3ee9e00eb41f tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.807622 Aug 24 08:00:16.386762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 554/1073] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Aug 24 08:00:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 08:00:16.398106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:16.398708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:16.451437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.459501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.464082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.464082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7a2a9668-4a18-4bb6-9463-3966dc2a4ea2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1281 microversion: 2.20 time: 0.067999 Aug 24 08:00:16.464082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 520/1074] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:16 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:16.538770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:16.539414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:16.547023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.547502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.547937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.548668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.549225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.549656 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.611541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.620513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e598c9c5-cb86-4d86-9642-5614bda87053 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085778 Aug 24 08:00:16.621236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 555/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:16.636628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:16.637196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:16.644699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.645179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.645607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.646288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.646733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.647148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.777562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.785608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-be961684-8309-4b59-8e8e-f18e5f1fa7d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152872 Aug 24 08:00:16.786160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 521/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:17.484586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:17.485157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:17.538021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.546133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.547643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.549400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e87ecc9-2f19-425b-91a8-def9d61e17c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1281 microversion: 2.20 time: 0.068159 Aug 24 08:00:17.550023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 556/1077] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:17 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:17.641726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:17.642523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:17.648995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.649479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.649913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.650590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.651074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.651488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.715532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.723655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f9922c7a-efb5-4562-82c8-f18616e9acd4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085716 Aug 24 08:00:17.724444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 522/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:17.806996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:17.807603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:17.815125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.815605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.816072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.816777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.817230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.817647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.949764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.958522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2deac9d7-afa9-48c0-962b-213774c1d7e6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155449 Aug 24 08:00:17.959090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 557/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:18.572974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:18.573593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:18.627527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.636061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.637644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.638765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6dbb9f4e-2533-47c7-950c-e2a9f597f1d0 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1281 microversion: 2.20 time: 0.069995 Aug 24 08:00:18.639354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 523/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:18 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:18.744896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:18.745528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:18.753027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.753506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.753934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.754770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.755216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.755636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.823214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.831773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-07ccc030-ae19-41d3-961a-8e9e82db1a9d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090882 Aug 24 08:00:18.832331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 558/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:18.980679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:18.981224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:18.988966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.989438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.989863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.990544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.990985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.991401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.994128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:19.121761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.129496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-825bfa4d-c352-471d-9773-184934d1203f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152844 Aug 24 08:00:19.130064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 524/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:19.662620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:19.663237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:19.715898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.723201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.724746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.725880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb5b032b-eef9-4ff6-baa7-0050a7d6288b tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1281 microversion: 2.20 time: 0.067731 Aug 24 08:00:19.726367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 559/1083] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:19 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:19.853412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:19.854039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:19.860802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.861997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.862334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.863030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.863479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.863903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.929225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.937227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb805237-4df0-41d0-9218-636333023116 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087574 Aug 24 08:00:19.937802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 525/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:20.150503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.151041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.156963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.157431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.158552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.159165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.159603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.160019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.292114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:20.299865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a98acb41-730f-4349-a82c-a547da016e38 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153396 Aug 24 08:00:20.300453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 560/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:20.747938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.748478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.755667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.759841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.759841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.759841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.759841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.760211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.819071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:20.827319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:20.828817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:20.830051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1b6e117f-614d-4751-a15d-9abbefeb1ef9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1285 microversion: 2.20 time: 0.085926 Aug 24 08:00:20.830741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 526/1086] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:20 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:20.958761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.959367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.965735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.966213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.966644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.967321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.967799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.968216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.028576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.036456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1bbc48e0-7c8c-45bb-a447-16a1814dc19a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082146 Aug 24 08:00:21.037045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 561/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:21.320600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:21.321231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:21.327220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.327689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.328117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.328829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.329273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.330488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.461711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.469405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-be77389d-6d88-4dbd-9c31-f4867a4f3a29 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152912 Aug 24 08:00:21.469970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 527/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:21.851818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:21.852451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:21.854342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:21.859114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.859534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.859964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.860708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.861896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.862322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.931190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.939561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.941080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.942451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-034c470d-2fd0-427b-af47-f05056d56e54 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1277 microversion: 2.20 time: 0.094454 Aug 24 08:00:21.943008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 562/1089] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:21 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:22.057387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:22.057990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:22.060315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:22.065538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.066001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.066435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.067154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.067680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.068106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.129541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.138049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c88a3587-1e3c-4311-835d-6d790395e753 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084459 Aug 24 08:00:22.142651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 528/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:22.490998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:22.491524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:22.498166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.498641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.499071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.499755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.500200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.500718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.693727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.701778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0975e421-6146-42ca-90bf-902f08427bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.215101 Aug 24 08:00:22.702359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 563/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:22.964505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:22.965239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:22.971821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.972385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.972909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.973681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.974189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.974669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.042229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.051758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.053269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.054359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c7f7eb21-a078-40dc-aec7-ec885855df3e tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1339 microversion: 2.20 time: 0.093822 Aug 24 08:00:23.054912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 529/1092] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:22 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:23.117146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:00:23.117757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:00:23.159880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.160494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.166377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.166907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.167336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.168008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.168456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.168884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.254827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.262603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8156030a-dcdb-4d53-bf7d-40ad20a9508a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.107645 Aug 24 08:00:23.263178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 564/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:23.724369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.728258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.735000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.735476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.735901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.738267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.738267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.738267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.877627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.885657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-15afb8a6-9a58-4ecb-812a-0ff6786182c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.166201 Aug 24 08:00:23.886222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 530/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:24.077637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.078250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.085083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.089400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.089400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.089400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.089400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.089775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.283434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.284818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.290833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.291421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.291928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.292700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.293253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.293741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.303594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.307153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:24.313554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.315161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.318919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d0c2bd0-6815-4018-af31-4c27b58a6a1c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.243698 Aug 24 08:00:24.318919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 565/1095] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:24.355619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.364021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0f3e885d-2486-41d5-ba67-a0197ae13ef4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084537 Aug 24 08:00:24.364625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 531/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:24.501088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e35b86b-53d6-4c53-8c30-04f63a390278", "tag": "bc89f8aa-a571-40af-a663-66aba4b33e72"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:24.510306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.510839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.511266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.522948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] Creating event network-changed:bc89f8aa-a571-40af-a663-66aba4b33e72 for instance 4e35b86b-53d6-4c53-8c30-04f63a390278 on hv-cinder-85427 Aug 24 08:00:24.528234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-7b626eac-7a0d-4dc0-abd2-b9e1cfd08348 req-31bb37e3-d9b8-4b73-9ef1-60c01e678bbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Aug 24 08:00:24.535821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 566/1097] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:24.906934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.907533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.914151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.914616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.915035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.915716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.916276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.916711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.059444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.068125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-29f57401-2711-4525-8fa9-108185eed918 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.164955 Aug 24 08:00:25.068721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 532/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:25.342299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:25.342915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:25.349964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.350444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.350876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.351566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.352016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.352444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.384948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:25.385553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:25.391466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.391935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.392359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.393062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.394135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.394590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.454760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.463076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fd3569ba-27e0-4663-9a58-b977e86c5864 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081878 Aug 24 08:00:25.463640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 533/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:25.486595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.494995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.496575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.497713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0924ba8d-5aeb-4765-8101-37cb43f22af9 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.160301 Aug 24 08:00:25.498307 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 567/1100] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:25 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:26.089364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.089967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.096284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.096789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.097219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.098491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.098927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.099337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.227708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.235391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f3a87b2d-82b2-4f35-bc19-96645743aaae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149846 Aug 24 08:00:26.235959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 534/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:26.484085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.484730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.486715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:26.492783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.493262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.493688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.494372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.494818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.495235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.520830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.521447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.527232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.527845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.528275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.528992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.529432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.530019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.558842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.567224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e115f9f5-6790-4938-9a95-0c88459c1da4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086390 Aug 24 08:00:26.567794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 568/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:26.661351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.669350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.670843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.671928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5fa2b177-f8de-4bd6-920b-3f096194612c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.154967 Aug 24 08:00:26.672484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 535/1103] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:27.257826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.258432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:27.264252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.270787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.270787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.270787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.270787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.271128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.398152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.407395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1d848f6-7de1-48bd-b6fd-ecb9580b5847 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154029 Aug 24 08:00:27.407983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 569/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:27.588909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.589442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:27.595866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.596336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.596789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.597532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.598748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.599248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.663149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.671568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9e5b7de0-c4a4-4677-9133-a47e3893262e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086432 Aug 24 08:00:27.672354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 536/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:27.695715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.696358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:27.703493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.703977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.710204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.710204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.710204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.710204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.847620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.856117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.857628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.858720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b875670b-8159-484d-8d27-2e8009920194 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.167909 Aug 24 08:00:27.859271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 570/1106] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:27 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:28.428826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:28.429439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:28.435430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.435909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.436344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.437057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.437504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.437923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.571943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.579751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5c4bcd8c-2952-4ce5-a31c-f9164c29d6aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154959 Aug 24 08:00:28.580312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 537/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:28.692842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:28.693368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:28.699551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.700131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.700437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.701170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.701613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.702032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.763743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.772356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e3782704-1bbd-4b7a-b8b2-2385bf796b68 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083956 Aug 24 08:00:28.772994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 571/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:28.881005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:28.881635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:28.883898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=8 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:28.888697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.889178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.889613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.890302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.890744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.891161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.025167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.033552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.035804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.036955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c99585aa-3e2a-4c18-94cc-31642af1e3a3 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.159926 Aug 24 08:00:29.037578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 538/1109] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:28 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:29.322931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e35b86b-53d6-4c53-8c30-04f63a390278", "name": "network-vif-plugged", "status": "completed", "tag": "bc89f8aa-a571-40af-a663-66aba4b33e72"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:29.332899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.333366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.333782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.344332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] Creating event network-vif-plugged:bc89f8aa-a571-40af-a663-66aba4b33e72 for instance 4e35b86b-53d6-4c53-8c30-04f63a390278 on hv-cinder-85427 Aug 24 08:00:29.349438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-69f77469-82f3-4eea-98eb-a916ff2f3068 req-f88d0d23-9269-47ed-8a2b-f7a6afddd39b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030462 Aug 24 08:00:29.350010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 572/1110] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:29.601028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:29.601652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.607819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.608420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.608893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.609587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.610041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.610456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.742885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.750709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bcc5fd5c-e14a-402b-85e1-aaa0223f4744 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153981 Aug 24 08:00:29.751277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 539/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:29.794176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:29.794867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.797314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=10 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:29.802964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.803438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.803864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.804535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.805079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.811503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.872282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.880278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c8da3ab5-c371-4446-bc2b-828bf7040f5c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090366 Aug 24 08:00:29.880865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 573/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:30.059097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:30.059721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:30.066251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.066828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.067256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.067940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.068380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.068838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.201396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:30.203705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:30.210839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:30.212353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:30.213507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6a967d90-39fc-483a-b759-bcabfdd214ad tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1407 microversion: 2.20 time: 0.158617 Aug 24 08:00:30.214100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 540/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:30 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:30.772749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:30.773428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:30.779524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.784437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.784437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.784437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.784437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.785354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.901737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:30.902453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:30.908516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.909012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.909435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.910156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.910626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.910990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.913245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:30.920894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4cde33ea-0774-4b22-8d33-99a52d1b5ee8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152078 Aug 24 08:00:30.921729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 574/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:30.971745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:30.979449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe9f25ba-31b2-488b-9bcf-3c31b0926dcc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081968 Aug 24 08:00:30.980009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 541/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:31.235555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:31.236224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:31.242860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.243338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.243771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:31.244463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.244944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.245383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:31.381374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:31.389517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:31.391023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:31.392180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f2bc87f-2c04-435a-83e4-75fcf720e5c4 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1598 microversion: 2.20 time: 0.160583 Aug 24 08:00:31.392769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 575/1116] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:31 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:31.414275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:31.414857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:31.421245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.421758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.422191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:31.422870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.423340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.423740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:31.500380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-90a8ff69-f21a-4e0f-90eb-684eb0c6d60c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090628 Aug 24 08:00:31.501003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 542/1117] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Aug 24 08:00:31 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:00:31.942590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:31.947012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:31.950414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.951106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.951539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:31.952240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:31.952708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:31.953161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:32.000913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:32.001508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:32.008445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:32.008962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:32.009396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:32.010085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:32.010531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:32.010954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:32.076589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:32.084521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-445e00df-d1ee-4502-a889-ab5b6c830418 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087621 Aug 24 08:00:32.085119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 543/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:32.155668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:32.164268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0aff7f2b-d287-40b6-94c4-827f90705141 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.226459 Aug 24 08:00:32.164916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 576/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:32.733008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e35b86b-53d6-4c53-8c30-04f63a390278", "tag": "bc89f8aa-a571-40af-a663-66aba4b33e72"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:32.745850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:32.746322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:32.746745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:32.759262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] Creating event network-changed:bc89f8aa-a571-40af-a663-66aba4b33e72 for instance 4e35b86b-53d6-4c53-8c30-04f63a390278 on hv-cinder-85427 Aug 24 08:00:32.765079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-40df65e0-8024-4c5b-ab9d-af49f04ed64f req-12e6aa30-320c-4821-ba31-7260b4d71593 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035628 Aug 24 08:00:32.765675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 544/1120] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:32.963645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:00:32.964173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:00:33.106143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:33.106977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:33.114178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:33.114782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:33.115314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:33.116116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:33.116693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:33.117216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:33.186337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:33.187214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:33.192704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:33.195696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:33.196438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:33.197126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:33.198060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:33.198736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:33.199515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:33.203581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-71c828af-5c65-4e53-9cf4-3122eedb3b85 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.101204 Aug 24 08:00:33.211195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 577/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:33.348263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:33.356721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-26ec120e-8879-41bf-bdd8-9ba460d79bf5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.174638 Aug 24 08:00:33.357307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 545/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:34.225900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:34.226540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:34.232997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:34.233472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:34.233898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:34.234574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:34.235066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:34.235485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:34.297747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:34.306037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6220397f-0948-47a7-b77e-dd32a57d0e13 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084274 Aug 24 08:00:34.306588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 578/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:34.378021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:34.378688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:34.385197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:34.385664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:34.386088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:34.386806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:34.387226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:34.387729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:34.515470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:34.523643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c1eb8c79-6b7d-4e8f-8fba-40ff93d5ffd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149579 Aug 24 08:00:34.524211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 546/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:35.327694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:35.328303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:35.335458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:35.335933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:35.336367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:35.337074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:35.337519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:35.337931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:35.403067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:35.410914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9cecc60b-1b62-4aad-bcb0-d530cf3ce1f0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087116 Aug 24 08:00:35.411473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 579/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:35.545176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:35.545786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:35.553051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:35.553531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:35.553972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:35.554750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:35.555210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:35.555629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:35.938437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:35.946652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e3f07866-991a-487a-a10e-0817bdaa86a1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.405360 Aug 24 08:00:35.947215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 547/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:36.431437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:36.432065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:36.438529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:36.439041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:36.439474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:36.440217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:36.440616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:36.441063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:36.502417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:36.510178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9dfb6413-c430-4c71-a6d2-097ec172841d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082584 Aug 24 08:00:36.510750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 580/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:36.967359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:36.967966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:36.974754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:36.975227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:36.975654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:36.976330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:36.976811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:36.977229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:37.106416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:37.114838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-35d662d8-5ee7-4dba-b3dc-6122989551a8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151364 Aug 24 08:00:37.115406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 548/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:37.531352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:37.532025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:37.539532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:37.540008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:37.540440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:37.541160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:37.541607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:37.542025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:37.603642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:37.611476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f88de87-d182-4c73-ab51-abcc1c9b3ee8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084050 Aug 24 08:00:37.612047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 581/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:38.136921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:38.137631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:38.143869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:38.144347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:38.144878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:38.145764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:38.146214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:38.146634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:38.279666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:38.288212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-44de265e-9135-4553-91a1-74cecb1b34be tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155108 Aug 24 08:00:38.288791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 549/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:38.632797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:38.633404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:38.639808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:38.640285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:38.640744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:38.641425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:38.641871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:38.642290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:38.705141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:38.713623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1aa5f67b-7fec-4995-8d3c-9012ba4175b8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084821 Aug 24 08:00:38.714200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 582/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:39.309706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:39.310375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:39.317622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:39.318096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:39.318524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:39.319201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:39.319904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:39.320317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:39.447790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:39.455365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a4f44017-adc7-465e-9b76-ec96057b659a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149485 Aug 24 08:00:39.455918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 550/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:39.735716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:39.736243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:39.743942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:39.744429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:39.744911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:39.747521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:39.747521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:39.747521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:39.811110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:39.814525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:39.819612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8bf6e06-54f0-4344-b45c-566bc6738e70 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087691 Aug 24 08:00:39.822481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 583/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:40.476836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:40.477443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:40.483837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.484314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.484770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.485453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.485908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.486325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.620259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:40.627968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-700c5a35-6cfa-443c-96ea-654822cf96a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155668 Aug 24 08:00:40.628534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 551/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:40.840358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:40.841015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:40.847793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.849248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.849733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.850409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.850849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.851261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.912095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:40.919756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c3d7e86-57d7-4df5-829e-5517daee3c6a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083194 Aug 24 08:00:40.920311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 584/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:41.649232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:41.649842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:41.655914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:41.656384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:41.656842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:41.657521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:41.657989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:41.658444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:41.788696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:41.796760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c67b246c-edca-45a5-8458-35810f737cad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151707 Aug 24 08:00:41.797372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 552/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:41.942869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:41.943503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:41.950201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:41.950756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:41.951158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:41.951846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:41.952309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:41.952772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.013899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:42.021773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9cd16986-0dfc-408f-84e0-e6321f781eda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082877 Aug 24 08:00:42.022339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 585/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:42.819138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:42.820089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:42.827490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.827962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.828386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.829091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.829533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.829947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.959370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:42.967071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e1f6410f-bac7-4c28-a5b8-c6d5e9942996 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152413 Aug 24 08:00:42.967634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 553/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:43.041908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:43.042491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:43.048864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.049332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.049790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:43.050464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.051413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.052114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:43.113247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:43.121776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c52ae3d8-e795-4484-8822-64018527b2e5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083822 Aug 24 08:00:43.122439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 586/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:43.987382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:43.987992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:43.994504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.994983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.995418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:43.996102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.996552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.997000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.133752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:44.141675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d46bc43f-8c2d-4fbd-a964-f78a9eb2dad7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158143 Aug 24 08:00:44.142243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 554/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:44.143397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:44.144122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:44.151304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:44.151824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:44.152224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.152931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:44.153404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:44.153821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.218722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:44.226693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c9cbcdc-ae90-4799-8e03-4264dd899d56 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087281 Aug 24 08:00:44.227256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 587/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:45.164019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:45.164634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:45.171321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.171797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.172227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.172963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.173427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.173845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.247364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:45.247970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:45.255485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.255996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.256425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.257162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.257605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.258041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.309264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:45.317849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4902beb4-110a-4510-986b-14b70f1d2e2d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158221 Aug 24 08:00:45.318617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 555/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:45.324296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:45.331933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-647acfc6-eb7a-45f9-a19a-4235bce25f75 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088504 Aug 24 08:00:45.332921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 588/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:46.339030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:46.339629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:46.345998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:46.346485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:46.346915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:46.348364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:46.348859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:46.349284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:46.353436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:46.354041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:46.360316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:46.360822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:46.361246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:46.361920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:46.362393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:46.362831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:46.424250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:46.432735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-361e580d-9094-408f-8be3-e95375f6be87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083092 Aug 24 08:00:46.433311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 589/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:46.484108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:46.492501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f90c000b-0b79-4365-8c6b-7b3885c3fa23 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157304 Aug 24 08:00:46.493127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 556/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:47.454324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:47.454973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:47.461475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.461975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.462402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.463083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.463530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.463950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.514174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:47.514784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:47.521411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.521884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.522311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.523055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.523503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.523921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.525434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:47.534136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6079a6cb-de7e-429e-99f1-9aa256e4159e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083650 Aug 24 08:00:47.534719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 590/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:47.655577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:47.663451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ad6a6a19-7d4e-46ad-afa4-3e788a08cf9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153202 Aug 24 08:00:47.664011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 557/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:48.556626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.557257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.563657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.564131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.564562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.565267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.565715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.566139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.631392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:48.640473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-152df64d-e278-4495-b554-62bc583f6094 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088217 Aug 24 08:00:48.641068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 591/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:48.684588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.685221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.691764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.692246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.692703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.693394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.693845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.694535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.709359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:48.829849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:48.837777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c0bf0dae-c2d6-4b47-9548-774d897b4354 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157029 Aug 24 08:00:48.838463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 558/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:49.662801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:49.663334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:49.669519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.669996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.670424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.671105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.671547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.671964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.733274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:49.741593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ffdd71ba-b7cc-4cb4-8290-05cd106a8f29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082985 Aug 24 08:00:49.742152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 592/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:49.858403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:49.859045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:49.866150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.866631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.867057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.867738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.868186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.868603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.999276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:50.008001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1e8bf391-5a93-4a3d-895c-3bd70b88aab1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153403 Aug 24 08:00:50.008565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 559/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:50.761957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:50.762566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:50.769062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.770050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.770478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.771162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.771610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.772029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.834190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:50.841907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5759d33a-a789-419d-9a81-e52415a7798c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083811 Aug 24 08:00:50.842474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 593/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:51.028658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:51.029266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:51.035620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.036092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.036526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.037238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.037685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.038097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.166187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:51.173830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-021dad8c-4bf9-4f61-89b7-236ca74803da tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.148979 Aug 24 08:00:51.174401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 560/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:51.862530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:51.863844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:51.870314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.870789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.871219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.871898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.872347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.872790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.933634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:51.941861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ec35c627-8b31-4bf3-8669-ca29ac0129d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082966 Aug 24 08:00:51.942478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 594/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:52.195800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:52.196349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:52.202765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.203240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.203669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.204368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.204878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.205298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.339180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:52.346923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-56b7049d-3ccd-4bce-8404-5f474c3a68dd tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155559 Aug 24 08:00:52.347595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 561/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:52.963148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:52.963786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:52.966091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=66 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:52.970721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.975178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.975178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.975178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.975178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.975634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.040096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:53.047817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e9378814-074b-48d9-88cf-201cd01a7eb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088512 Aug 24 08:00:53.048372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 595/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:53.367854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:53.368465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:53.374986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.375464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.375894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.376585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.377060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.377484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.508166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:53.515796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-26fe2252-d47d-4911-8de0-0af87ab94532 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152301 Aug 24 08:00:53.516352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 562/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:54.069684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:54.070295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:54.076628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.077129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.077564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.078283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.078718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.079138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.139646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:54.148211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0fc24b41-b2d4-4d4e-8858-f35209c559ae tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083341 Aug 24 08:00:54.148806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 596/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:54.538250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:54.538862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:54.541212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=70 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:54.545965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.546444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.546877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.547559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.548010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.548428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.683274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:54.691061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f1030e47-f7a3-4846-b711-7fa58e92afa3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156892 Aug 24 08:00:54.691844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 563/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:55.169171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:55.169777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:55.176476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.176980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.177407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.178093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.178536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.178951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.239739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:55.247523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b47f51ac-8493-405d-9f28-523cdf748b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082227 Aug 24 08:00:55.248082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 597/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:55.712265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:55.712890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:55.719402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.719877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.720316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.721007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.721447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.721857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.851288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:55.859145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-08a991ae-26a8-4a5a-b15b-086d70858c9f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150617 Aug 24 08:00:55.859709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 564/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:56.268429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:56.269100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:56.275615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.276095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.276528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.277247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.277708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.278131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.339208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:56.346972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af235436-29d1-4b6e-a714-76ce23d8fa41 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082464 Aug 24 08:00:56.348096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 598/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:56.880799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:56.881427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:56.887821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.888291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.888742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.889421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.889863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.890277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.022208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:57.029797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9cf5531-3c0d-47fb-a8b2-5eb133c88616 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153380 Aug 24 08:00:57.030364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 565/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:57.369003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:57.369612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:57.376034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.376539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.377000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.377684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.378130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.378848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.442783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:57.450766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-74215964-5e42-4403-9b69-e734272780e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085763 Aug 24 08:00:57.451324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 599/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:58.051016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:58.051618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:58.058259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:58.058726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:58.059147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:58.059820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:58.060265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:58.060721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:58.195964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:58.203728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f0d553e-1770-407c-bc28-322f5bd367b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156781 Aug 24 08:00:58.204294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 566/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:58.471452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:58.472101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:58.478596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:58.479069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:58.479506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:58.480208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:58.480637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:58.481081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:58.499035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:58.543141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:58.551049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f44f554-376d-45e8-9ec7-7701400c647a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083380 Aug 24 08:00:58.551785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 600/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:59.224803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:59.225407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:59.231779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:59.232252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:59.232701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:59.233383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:59.233829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:59.234247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:59.361475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:59.369411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f9edda37-0b92-40d4-b0f5-d861fc55681a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.148516 Aug 24 08:00:59.369979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 567/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:59.573064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:59.573672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:59.580159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:59.580628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:59.581089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:59.581773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:59.582221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:59.582638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:59.642752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:59.650641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78e288ee-17c0-4ccb-b5fc-f20afddb0ad9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081772 Aug 24 08:00:59.651208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 601/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:00.391086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:00.391624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:00.398783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.399255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.399682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.400362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.400843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.401261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.537977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:00.545674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7fcfc17f-7a0e-4559-8998-16fd97dddf43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158579 Aug 24 08:01:00.546240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 568/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:00.671347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:00.671877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:00.679193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.679661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.680087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.680788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.681245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.681686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.745034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:00.752719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-665edbd7-31c1-41aa-8813-0d3b28dae821 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085257 Aug 24 08:01:00.753296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 602/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:01.567487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:01.568084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:01.574811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.575283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.575713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.576395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.576888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.577293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.712078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:01.721859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e599b401-5fe7-468f-96db-3715a434ad24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.159305 Aug 24 08:01:01.722439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 569/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:01.773501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:01.774089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:01.780566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.781074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.781506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.782198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.782648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.783142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.858139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:01.867224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5856d4df-2c97-4004-ae28-c006d4bdaa34 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.097558 Aug 24 08:01:01.868048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 603/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:02.745160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:02.745764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:02.752247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.752745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.753197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.754803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.755293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.755711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.889187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:02.889682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:02.889801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:02.896452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.896944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.897366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.898046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.898223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5343c73c-b2b9-431b-8750-29f3b484aaa4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157119 Aug 24 08:01:02.898486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.898801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 570/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:02.898956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.960374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:02.968024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-652ac421-1d3e-4f54-93e2-f4d5212dfe69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082985 Aug 24 08:01:02.968582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 604/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:03.919976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:03.920577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:03.927698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.928166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.928593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:03.929300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.929747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.930164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:03.990498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:03.991123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:03.997479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.997952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.998376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:03.999059 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.999498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.999913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:04.064126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:04.070787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:04.073244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7b695db6-9f10-4d9d-b8a3-55585da9b8a4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157093 Aug 24 08:01:04.073817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 571/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:04.078772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d01a147-8640-46fe-9361-fd7f96f7a797 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.092231 Aug 24 08:01:04.079335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 605/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:05.094264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:05.094878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:05.101802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:05.102291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.102405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:05.102498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.102838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.103530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.104012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.104393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.108930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.109403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.109883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.110570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.111058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.111484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.175421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:05.185420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4da716b5-4ce0-47aa-92d2-b49025e103fa tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086833 Aug 24 08:01:05.185420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 606/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:05.241219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:05.248935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-80ff248a-76bc-4368-945b-2e6f687c2246 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158461 Aug 24 08:01:05.249496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 572/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:06.204693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:06.205325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:06.211927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.212391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.212959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.213632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.214073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.214487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.270296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:06.270978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:06.277783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.278274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.278384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:06.278701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.279387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.279824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.280234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.286563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1e5c9aae-e0a4-46b4-9fb3-d0db07b78283 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085777 Aug 24 08:01:06.287221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 607/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:06.413968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:06.421692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8552f630-ecce-4c3a-ae57-e9c73bde4c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155284 Aug 24 08:01:06.422262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 573/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:07.306788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:07.307372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:07.313845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.314320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.314748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.315441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.315873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.316289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.379629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:07.387988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4eaa49bc-e838-4698-98f1-3ae19fc1f010 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085100 Aug 24 08:01:07.388546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 608/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:07.443682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:07.444547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:07.450957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.451452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.451867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.452552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.453026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.453447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.584112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:07.591882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f206f7f3-333c-4b41-9e75-b4ada86b963b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152562 Aug 24 08:01:07.592454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 574/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:08.408956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:08.409565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:08.416882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.417359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.417789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.418472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.418919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.419335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.479592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:08.487316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1850118e-1c71-47ef-beff-77f495ec4859 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082300 Aug 24 08:01:08.487874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 609/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:08.612482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:08.613120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:08.619515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.619982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.620405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.621120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.621565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.621980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.624452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:08.765824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:08.774770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-04414ca6-9063-47d9-8910-bf5d4d8faf33 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.166099 Aug 24 08:01:08.775336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 575/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:08.859616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:08.860142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:08.866097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.866566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.866996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.867672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.868113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.868526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.891483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78e7d8d3-f4e5-434c-8666-3d18d0ec88a2 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278/ips" status: 200 len: 151 microversion: 2.20 time: 0.035779 Aug 24 08:01:08.892110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 610/1185] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Aug 24 08:01:08 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:01:09.508232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:09.508908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:09.515499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.516038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.516473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.517206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.517658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.518074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.581673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:09.589749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7685182d-4685-46bd-917e-ba8eb120c88d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086377 Aug 24 08:01:09.590308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 576/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:09.795849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:09.796398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:09.804369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.804873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.805303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.805987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.806433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.806847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.937141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:09.945518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d2e8dfb-5fa1-4169-b8e0-c9849e48bb16 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153667 Aug 24 08:01:09.946090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 611/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:10.611019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:10.611654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:10.618237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:10.618708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:10.619135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:10.619816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:10.620257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:10.620696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:10.681186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:10.688873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d041d90f-58ae-4243-b135-b8258c784b19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081685 Aug 24 08:01:10.689430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 577/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:10.966495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:10.967105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:10.973509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:10.973988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:10.974457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:10.975142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:10.975587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:10.976002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.194992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:11.202756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9d7cf5a-da2b-4a0e-a1d8-a88d3c6c76ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.240083 Aug 24 08:01:11.203327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 612/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:11.712062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:11.712679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:11.718744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.719154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.719578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.720245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.720701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.721117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.783180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:11.790930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-af2f01b9-344b-40e9-aeb0-330317168c05 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083850 Aug 24 08:01:11.791494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 578/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:12.223384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:12.223988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:12.230381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.230844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.231274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.231944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.232382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.232822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.366270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:12.374118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-870f5d91-d758-4e55-80d9-ebf41c6fd29c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154607 Aug 24 08:01:12.374688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 613/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:12.811445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:12.812050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:12.818962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.819437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.819860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.820534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.821003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.821413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.885226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:12.892818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84635042-1034-4125-a7a3-579940574cb5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085129 Aug 24 08:01:12.893374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 579/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:13.395707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:13.397100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:13.403628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.404102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.404537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.405243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.405692 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.406104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.535466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:13.543324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a49dcd1b-364e-4fe0-9128-1b758be14da0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151497 Aug 24 08:01:13.543881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 614/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:13.913538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:13.914152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:13.920542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.921053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.921488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.922174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.922623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.923041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.984080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:13.992427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c39fb1a-eab0-4f07-87ec-72439305a108 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082713 Aug 24 08:01:13.993026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 580/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:14.564339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:14.565007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:14.571774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.572222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.572666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.573337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.573775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.574186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.705433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:14.714066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-953dbd62-9c9f-43d1-b543-c67f52a6fe51 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153618 Aug 24 08:01:14.714633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 615/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:15.014262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:15.014890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:15.021409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.022034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.022473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.023160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.023612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.024036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.085132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:15.093161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c28b5c88-f31d-4769-a230-54240476fd6f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082654 Aug 24 08:01:15.093734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 581/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:15.736724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:15.737332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:15.743695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.744164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.744592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.745304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.745751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.746166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.878293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:15.886564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8439294-2432-4fa4-b011-3cc2817874b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153749 Aug 24 08:01:15.887126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 616/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:16.114343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:16.115586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:16.121840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.122316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.122744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.123421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.123865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.124281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.187226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:16.196052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-54dd2b59-fe57-452b-aac9-208dc84dc067 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085695 Aug 24 08:01:16.196619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 582/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:16.907949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:16.908548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:16.915670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.916137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.916560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.917265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.917705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.918124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.935975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:17.047169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.055080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-48f66d97-31b5-4f89-9f93-501c0b32083c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151004 Aug 24 08:01:17.055646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 617/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:17.217212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:17.217751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:17.224157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.225153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.225581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.226260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.226708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.227120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.290350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.298117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c4e5d125-3d80-41df-89d5-692440061c93 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084811 Aug 24 08:01:17.298679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 583/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:18.076626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:18.077251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:18.084333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.084838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.085267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.085946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.086394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.086810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.223482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:18.231456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2eae5e10-f093-475c-be54-f85479bcf30c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158828 Aug 24 08:01:18.232024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 618/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:18.320163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:18.320792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:18.327202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.327616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.328042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.328750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.329199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.329613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.391397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:18.399783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-08d819db-2324-4400-b465-c1e89b1fed6c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084294 Aug 24 08:01:18.400339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 584/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:19.253089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.253705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:19.260982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.261462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.261890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.262573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.263017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.263434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.391700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.399684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84b01524-364f-4db1-b1de-eca8e141dbd2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150502 Aug 24 08:01:19.400249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 619/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:19.421091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.421706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:19.428930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.429416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.429850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.430540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.430984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.431402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.492888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.500454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b1ee8029-a74e-490f-a319-30b9172e2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083208 Aug 24 08:01:19.501041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 585/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:20.421177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:20.421793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:20.428871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.429350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.429783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.430465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.430910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.431328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.521896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:20.522534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:20.529181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.529663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.530094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.530788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.531237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.531654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.564435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:20.573436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae66e272-949d-4a81-baf1-cae497585018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156052 Aug 24 08:01:20.574017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 620/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:20.595143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:20.603361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f4a652da-702f-41a4-9d31-18a43d6aba9b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085648 Aug 24 08:01:20.603929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 586/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:21.594582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:21.595192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:21.601982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.602465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.602895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.603610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.604127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.604551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.624538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:21.625191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:21.632008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.632484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.632985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.633668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.634108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.634521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.699501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.707310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9bde1552-415c-4db5-8b1d-e32b3c4c6e29 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086549 Aug 24 08:01:21.707971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 587/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:21.737611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.745736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-91666962-e58d-4745-9666-534ff9d109f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155152 Aug 24 08:01:21.746324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 621/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:22.729422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:22.730030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:22.736512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.737012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.737442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.738123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.738566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.738979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.769063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:22.776538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:22.776907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.777390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.777852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.778546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.778991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.779436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.805879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.810152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72a3d9c1-4e57-4724-9baf-21c0ebd65761 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084602 Aug 24 08:01:22.810725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 588/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:22.914495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.922185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8526a526-34b6-4111-af56-83bbad8d29ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156858 Aug 24 08:01:22.922750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 622/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:23.831209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:23.831837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:23.838466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.838935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.839362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.840034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.840472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.840908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.903670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:23.911275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-935e9bfa-7fd4-402a-8df0-b2087c40894e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083898 Aug 24 08:01:23.912355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 589/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:23.942831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:23.943824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:23.946055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=56 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:23.950727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.951208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.951666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.952351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.952871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.953291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.088342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:24.096123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5fcc580f-df09-4132-ab62-99d3779c0ded tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157165 Aug 24 08:01:24.096712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 623/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:24.932413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.933079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:24.935368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=54 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:24.939975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.940442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.940902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.941584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.942027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.942444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.004110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.011650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-24ed1888-c953-4751-9837-48839ab50f69 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083045 Aug 24 08:01:25.012209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 590/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:25.117790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:25.118445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:25.124860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.125336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.125767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.126451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.126902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.127324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.256798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.264404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c510a426-4441-4887-a0ab-6498e96db375 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150530 Aug 24 08:01:25.265000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 624/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:26.033160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:26.033747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:26.040925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.041392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.041817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.042486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.042929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.043342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.107985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:26.110194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:26.117138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-61a16ada-af6c-473b-9257-ca6e691c3360 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087868 Aug 24 08:01:26.117697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 591/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:26.286199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:26.287169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:26.293517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.293982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.294405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.295079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.295526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.295938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.429362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:26.437073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0d28c931-6266-4243-98d3-c89e8d218cb6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154719 Aug 24 08:01:26.437635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 625/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:27.137877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:27.138482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:27.145038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:27.145512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:27.146458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:27.147280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:27.147722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:27.148137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:27.209050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:27.216671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3b0dcfc0-8ce9-406c-9e6d-483b91b0041d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082952 Aug 24 08:01:27.217250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 592/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:27.459521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:27.460062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:27.466580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:27.467072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:27.467499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:27.468172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:27.468614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:27.469053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:27.601940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:27.609733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d3ff5db9-140d-4aae-8160-1bde3f66d4ca tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154825 Aug 24 08:01:27.610291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 626/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:28.237680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:28.238280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:28.245065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.245539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.245968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.246645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.247090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.247502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.310121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:28.318811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1a3388ec-f3f0-43a0-9fc3-ef676e7e5e4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084173 Aug 24 08:01:28.319357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 593/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:28.631491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:28.632100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:28.638607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.639078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.639512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.640190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.640635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.641075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.768509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:28.776560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-59ae6f55-738a-4c5f-891d-1c2273641227 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149611 Aug 24 08:01:28.777154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 627/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:29.339623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:29.340201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:29.346648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.347118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.347539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.348214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.348669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.349221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.411060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:29.419163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-40e95cd6-5725-4b26-9125-177d9371685e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083339 Aug 24 08:01:29.419728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 594/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:29.796970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:29.797517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:29.804737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.805214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.805646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.806327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.806770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.807189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.940861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:29.948958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2dfa1e52-0902-48c5-a0cd-f69aaff6991f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155943 Aug 24 08:01:29.949525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 628/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:30.440559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:30.441143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:30.448070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.448539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.448992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:30.449701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.450171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.450582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:30.517604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:30.526159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bbc01c6a-6ccd-4702-a628-8a67895f6fe7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089484 Aug 24 08:01:30.526723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 595/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:30.970522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:30.971129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:30.977571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.978035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.978460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:30.979126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.979566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.979979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:31.108138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:31.115874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8ecc5c41-a8a7-4756-b084-348b1c9e48f2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149159 Aug 24 08:01:31.116441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 629/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:31.546501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:31.547100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:31.553549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:31.554025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:31.554455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:31.555803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:31.556250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:31.556682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:31.617198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:31.624812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-721eff99-dafe-476a-8582-5f20a4a463ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082173 Aug 24 08:01:31.625378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 596/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:32.136628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:32.137252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:32.143599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.144067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.144491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:32.145188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.145628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.146038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:32.280309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:32.288202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-89027a4d-4331-4f74-a250-135d0685bbff tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155603 Aug 24 08:01:32.288809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 630/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:32.645771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:32.646373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:32.653703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.654175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.654606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:32.655295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.655771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.656189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:32.719459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:32.727212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4a06f66c-2b6f-4470-b5cc-364a1f41f320 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085282 Aug 24 08:01:32.728019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 597/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:33.310109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:33.310717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:33.317154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:33.317628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:33.318060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:33.318990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:33.319434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:33.319848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:33.448077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:33.455801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9dd6c9bb-c41d-4635-8b9f-b15d456486a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150198 Aug 24 08:01:33.456366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 631/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:33.748980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:33.749496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:33.755962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:33.756441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:33.758886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:33.758886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:33.758886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:33.758886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:33.822962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:33.830819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d76cca9f-5c49-4c31-86a4-e2a432819b0b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085895 Aug 24 08:01:33.831429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 598/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:34.476848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:34.477542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:34.483952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.484424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.484893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.485574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.486025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.486441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.618775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:34.626821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a3767603-f492-4825-9011-ce176725848a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153821 Aug 24 08:01:34.627391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 632/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:34.851135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:34.851730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:34.858373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.858839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.859268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.859939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.860375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.860822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.925180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:34.933609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7feb71ad-456b-460f-bd73-0d27354ae987 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086235 Aug 24 08:01:34.934523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 599/1231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:35.648430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:35.649064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:35.656129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.656598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.657068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:35.657750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.658225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.658642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:35.787465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:35.795263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-985d9397-e3d1-40ea-afc8-96642b72338c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150680 Aug 24 08:01:35.795826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 633/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:35.954518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:35.955119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:35.961502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.961971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.962397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:35.963997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.964478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.964920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:36.027255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:36.034832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-faa42cbf-29c2-415a-a706-70886efb523e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084151 Aug 24 08:01:36.035441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 600/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:36.815418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:36.816053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:36.823774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:36.824240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:36.824687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:36.825367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:36.825806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:36.826219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:36.830125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:36.955484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:36.963068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8cb4eeb0-be7c-4c59-8801-ab13db393412 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151606 Aug 24 08:01:36.963779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 634/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:37.057222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:37.057953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:37.064288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.064802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.065231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:37.065975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.066355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.066767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:37.127216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:37.135464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0870a381-19b3-4f51-9d53-8456c47c6bdb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081999 Aug 24 08:01:37.136027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 601/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:37.983793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:37.984394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:37.990758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.991226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.991649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:37.992319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.992787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.993199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:38.129637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:38.138221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c73ad3b1-ae41-4107-9e44-d1ec4f54ea52 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158283 Aug 24 08:01:38.138791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 635/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:38.155810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:38.156416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:38.162793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:38.163266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:38.163697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:38.164378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:38.164857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:38.165271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:38.229633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:38.237578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c84fdeb9-0774-46ab-9ade-92e9caf8b2f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085595 Aug 24 08:01:38.238084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 602/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:39.159276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:39.159875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:39.167071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.167541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.167970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:39.168696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.169145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.169563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:39.258895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:39.259552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:39.265976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.266457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.266888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:39.267629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.268022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.268440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:39.298952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:39.306941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e0f53eb1-c2a0-41e3-8d93-e755aeefae39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151451 Aug 24 08:01:39.307515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 636/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:39.334911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:39.343218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-50a049a4-148b-4737-829f-346b3ae16406 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088130 Aug 24 08:01:39.343794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 603/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:40.327398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:40.328029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:40.334325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:40.334788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:40.335208 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:40.335884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:40.336320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:40.336751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:40.364482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:40.365142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:40.372342 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:40.372850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:40.373288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:40.373977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:40.374451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:40.374875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:40.437354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:40.445487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-db35e2ab-9d75-49a1-ba26-87d0eb715e30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084796 Aug 24 08:01:40.446067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 604/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:40.477067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:40.480156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a7c1b86b-79cc-48e7-ba36-12e7e8626b4f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156634 Aug 24 08:01:40.480750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 637/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:41.466550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:41.467230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:41.473146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.473614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.474038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.474712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.475149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.475561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.500823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:41.501518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:41.507964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.508433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.508886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.510253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.510996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.511417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.537347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:41.545681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f84b4291-4b8f-4afc-a2fd-20eff74805d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083102 Aug 24 08:01:41.546255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 605/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:41.643996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:41.651803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0335af0a-039a-42ee-96a6-7c033b033ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154821 Aug 24 08:01:41.652372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 638/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:42.567160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:42.567799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:42.574760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.575250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.575693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.576362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.576844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.577260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.638850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:42.646525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a482f035-484a-4fc9-b856-20d6145c057c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083248 Aug 24 08:01:42.647030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 606/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:42.672973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:42.673592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:42.680140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.680615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.681070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.682747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.683202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.683650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.814262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:42.822431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8b80b45-dd15-48d5-8f85-df4faddc312d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153279 Aug 24 08:01:42.823037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 639/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:43.667302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:43.667930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:43.674481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.674944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.675362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:43.676029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.676466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.676904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:43.740610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:43.749041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-74b1c125-3ace-4336-9eb2-68e6943c3f0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085781 Aug 24 08:01:43.749605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 607/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:43.843128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:43.843740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:43.850125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.850598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.851035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:43.851712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.852159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.852575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:43.987234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:43.995865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a2a9f91d-5deb-4344-b840-56748957a12b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156507 Aug 24 08:01:43.996434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 640/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:44.770247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:44.770851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:44.777855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:44.778323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:44.778750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:44.779420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:44.779860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:44.780270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:44.794878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:44.842088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:44.849598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-db282281-97a9-4a3d-9421-35bccfdbdbf8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083195 Aug 24 08:01:44.850151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 608/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:45.016537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:45.017191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:45.023727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.024207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.024684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.025519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.025970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.026394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.158574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:45.166801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5749e6a6-eb34-4c50-907c-dbc05e1274ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154129 Aug 24 08:01:45.167370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 641/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:45.870503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:45.871095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:45.877548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.878015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.878435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.879106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.879543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.879955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.942519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:45.950789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4edf7681-4f13-4772-9bd3-9f38c354e258 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084203 Aug 24 08:01:45.951345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 609/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:46.187504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:46.188069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:46.194575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.195047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.195473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:46.196149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.196593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.197797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:46.336747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:46.345154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-609f468b-6fb9-47f4-8b52-431e647b54a6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.161539 Aug 24 08:01:46.345729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 642/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:46.971945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:46.972552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:46.979687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.980158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.980586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:46.981291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.981744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.982161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:47.043127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:47.050870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb83fb39-91cd-4217-bd5a-91c7df2d48e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082889 Aug 24 08:01:47.051431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 610/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:47.365657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:47.366294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:47.372841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:47.373314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:47.373743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:47.374421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:47.374868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:47.375284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:47.503914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:47.511807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2310f491-da3c-44e9-a5b2-c92c2a89a6ac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150035 Aug 24 08:01:47.512378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 643/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:48.073114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:48.073719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:48.080149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.080628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.081082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:48.081763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.082213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.082629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:48.148634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:48.156965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fca99c7d-741e-4230-ae0f-263da25ef97f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088062 Aug 24 08:01:48.157531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 611/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:48.533228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:48.533838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:48.540261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.540850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.541327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:48.542010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.542464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.542880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:48.674667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:48.683415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9e990eea-ff93-48d7-9343-5467988b7f09 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154059 Aug 24 08:01:48.683974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 644/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:49.177191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:49.177806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:49.184233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:49.184735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:49.185170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:49.185849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:49.186296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:49.186713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:49.248090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:49.255748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1fd4a20a-ce1e-4729-94c4-b0da54ef6eb4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082336 Aug 24 08:01:49.256315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 612/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:49.704393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:49.705025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:49.711079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:49.711546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:49.711968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:49.712697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:49.713141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:49.713558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:49.841404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:49.849174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-68f78cf4-ee7e-4a01-a9b1-49f60fc00ddc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.148552 Aug 24 08:01:49.849738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 645/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:50.277564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:50.278172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:50.284566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.285062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.285486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:50.286156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.286597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.287008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:50.429731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:50.438250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-40e65b41-bcd7-4317-b260-91b3b0a21ba5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.164763 Aug 24 08:01:50.438809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 613/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:50.870847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:50.871455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:50.878287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.878769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.879212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:50.879895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.880347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.880798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:51.059918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:51.067667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6f16d649-67f5-4483-aaee-905a0122faac tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.201179 Aug 24 08:01:51.068504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 646/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:51.459725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:51.460372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:51.466952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:51.467424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:51.467855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:51.468535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:51.469015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:51.469430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:51.530428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:51.538179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3be343c-a230-4830-a6d6-dee3bc9dad61 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082367 Aug 24 08:01:51.538742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 614/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:52.089390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:52.089996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:52.096387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.096889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.097312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.098022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.098462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.098873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.447300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:52.455026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9b3aa49f-7adb-470d-bc8d-674bc4ff4082 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.370097 Aug 24 08:01:52.455588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 647/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:52.559843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:52.560442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:52.566852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.567321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.567744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.568705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.569146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.569555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.635743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:52.643755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9d99b289-0b59-479b-ad63-585d5b45aeda tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088299 Aug 24 08:01:52.644419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 615/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:53.476909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:53.477509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:53.484796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.485266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.485689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.486362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.486806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.487219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.620258 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:53.627916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-850d9556-6b33-4833-ae53-11e65c7e0e3d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154845 Aug 24 08:01:53.628480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 648/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:53.664017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:53.664554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:53.671638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.672111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.672546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.673261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.673713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.674131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.734842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:53.742440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d017a033-d4df-4484-9aec-503d64301691 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082340 Aug 24 08:01:53.743004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 616/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:54.650255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:54.650867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:54.653599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=52 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:54.658349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.658821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.659243 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:54.659919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.660360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.660799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:54.763782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:54.764521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:54.770983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.771629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.772130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:54.772944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.773495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.773915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:54.793246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:54.800979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-04b10b4e-9b5f-4e5c-b1cd-bac99d7c6018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155427 Aug 24 08:01:54.801550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 649/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:54.835955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:54.844155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-add7ae99-f7e8-4b91-972f-5da9b7019f87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084447 Aug 24 08:01:54.844744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 617/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:55.823126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:55.823789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:55.830510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:55.830986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:55.831419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:55.832110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:55.832553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:55.833001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:55.864985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:55.865682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:55.868052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=56 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:55.873877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:55.874361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:55.874795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:55.875497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:55.875981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:55.876402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:55.941565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:55.949619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fc45294f-7477-4547-9b70-71c278de64ad tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088468 Aug 24 08:01:55.950413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 618/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:55.965357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:55.968902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:55.973615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ee4430f-92b6-4b64-a99c-a292a39375f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155380 Aug 24 08:01:55.974190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 650/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:56.969742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:56.970346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:56.976860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.977334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.978623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.979338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.979796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.980216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.999431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:57.000134 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:57.006595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:57.007064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:57.007489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:57.008164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:57.008609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:57.009053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:57.046416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:57.054284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d78b5b2b-1811-48ea-88a3-05bfddf81c5a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088465 Aug 24 08:01:57.054863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 619/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:57.144800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:57.152922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6f08f82c-e82a-4127-8623-2e5c8d450a63 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157698 Aug 24 08:01:57.153493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 651/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:58.075640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:58.076247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:58.082784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.083285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.083713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.084392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.084869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.085288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.147373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:58.156222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f1f8b19-c503-4ebe-8b66-00fc92fc672b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084566 Aug 24 08:01:58.156811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 620/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:58.174097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:58.174697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:58.181137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.181603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.182026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.182697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.183136 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.183637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.313640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:58.322343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39ff6187-b02c-41d6-9063-23b3272b35f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152109 Aug 24 08:01:58.323013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 652/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:59.177704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:59.178283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:59.186046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.186541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.186964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.187648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.188087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.188499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.249543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:59.257230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cdbb96bb-16df-41d7-9860-694a699c9677 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083339 Aug 24 08:01:59.257792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 621/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:59.343744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:59.344378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:59.350869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.351339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.351775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.352453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.353808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.354235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.482877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:59.490530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fd94c481-d4b7-41eb-87f8-105817e31f92 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150610 Aug 24 08:01:59.491096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 653/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:00.278355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:00.278967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:00.285441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.285918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.286383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:00.287068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.287554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.287976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:00.352308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:00.360258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ce61af44-3fc7-4921-8f26-d148c599c7c7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085866 Aug 24 08:02:00.360842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 622/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:00.511632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:00.512234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:00.518610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.519082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.519508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:00.520180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.520620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.521055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:00.653124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:00.660877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87e85c48-002c-4c17-9f0a-8329d3ae8935 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153497 Aug 24 08:02:00.661457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 654/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:01.381773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:01.382375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:01.389184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:01.389656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:01.390083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:01.390762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:01.391206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:01.391626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:01.456324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:01.464731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b263c31-eadc-415f-bd80-d11829c53ead tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086786 Aug 24 08:02:01.465294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 623/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:01.683344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:01.683985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:01.690448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:01.690922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:01.691378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:01.692065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:01.692521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:01.693244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:01.831683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:01.839664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da013465-85e2-419b-8938-baf1fa920c28 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.160856 Aug 24 08:02:01.840239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 655/1278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:02.485451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:02.486052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:02.492476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.492985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.493553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:02.494232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.494676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.495134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:02.556049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:02.563727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d4682611-11ea-41e4-af22-050d3b0f22b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082129 Aug 24 08:02:02.564281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 624/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:02.861074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:02.861715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:02.868838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.869501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.869936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:02.870636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.871065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.871482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:03.004638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:03.012505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-52f7d62a-940a-4940-b357-be94b12e7477 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155214 Aug 24 08:02:03.013096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 656/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:03.584427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:03.585065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:03.592702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:03.593257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:03.593700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:03.594404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:03.594854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:03.595280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:03.598084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:03.663977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:03.673817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-37851f03-a83a-4c67-b3e7-2a4612242142 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.093269 Aug 24 08:02:03.674392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 625/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:04.034211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:04.034818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:04.042504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.042998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.043422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.044426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.045285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.046020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.204158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.212658 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-34536ac4-a113-4847-9e49-72685513c67d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.181779 Aug 24 08:02:04.213328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 657/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:04.695683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:04.696971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:04.703398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.703871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.704300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.705013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.705462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.705880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.766919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.774792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c09f3074-abff-460a-82a2-3e2571011a22 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083240 Aug 24 08:02:04.775359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 626/1283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:05.233424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:05.234064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:05.240492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.240987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.241412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.242109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.242548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.242971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.373555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:05.381329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24180893-1857-4b72-825a-ac5755528562 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151805 Aug 24 08:02:05.381897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 658/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:05.796315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:05.796881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:05.803706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.804176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.804605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.805318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.806397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.806814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.871274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:05.879016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5616364e-50d0-43e1-bf2c-466461285f30 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086645 Aug 24 08:02:05.879579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 627/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:06.402711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:06.403301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:06.409745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:06.410244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:06.410668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.411343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:06.411785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:06.412198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.549126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.557049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b060a81e-edf3-4c9f-bffd-4cfb6e287fd3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158769 Aug 24 08:02:06.557655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 659/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:06.900450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:06.901089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:06.907443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:06.907910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:06.908332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.909042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:06.909482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:06.909891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.973457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.981480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-452d2699-4fdb-4cfc-b791-75f1047bfd37 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085199 Aug 24 08:02:06.982029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 628/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:07.578210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:07.578827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:07.585237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.585709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.586139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.587496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.587918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.588335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.718100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:07.725720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-246b64b3-774a-4b4e-940b-75294ee8a6ed tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151449 Aug 24 08:02:07.726283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 660/1288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:08.001616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.002201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.009086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.009595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.010013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.010682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.011121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.011530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.073208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:08.080907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cfe80da8-e16a-4397-9349-4a6f6e25898e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083067 Aug 24 08:02:08.081462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 629/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:08.748254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.748884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.755305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.755771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.756195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.756922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.757362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.757772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.893877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:08.901677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1820383f-7671-4a5c-9c07-8f8a7fe59c34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157246 Aug 24 08:02:08.902583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 661/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:08.936670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.937163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.943538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.944028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.944470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.945193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.945652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.946113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.970238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:02:09.102003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:09.102647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:09.108739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.111686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.111686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.111686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.111686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.112083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.172506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.180168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-062f3790-e916-47f2-85a7-8429a7e59a35 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082111 Aug 24 08:02:09.181445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 662/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:09.306296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0eb369fd-9d99-40b5-bb08-a835857edc65 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 204 len: 0 microversion: 2.20 time: 0.372626 Aug 24 08:02:09.306970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 630/1292] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 24 08:02:08 2022] DELETE /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:02:09.315121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:09.315725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:09.322711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.323179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.323616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.324298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.324777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.325198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.452228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.460386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.462072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.463373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dd2faa8a-9a23-4c6f-9dcb-af6f3ff43b49 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1723 microversion: 2.20 time: 0.152209 Aug 24 08:02:09.463926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 663/1293] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:09 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:09.923338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:09.924024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:09.929934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.930459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.931157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.931838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.932281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.932717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.062723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.070644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ecb60b60-7ae3-49c8-87b0-7061ce885443 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151563 Aug 24 08:02:10.071842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 631/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:10.205482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:10.206089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:10.212869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.213343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.213772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.214447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.214888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.215301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.279882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.287551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e8d2878-02f5-404b-aba6-0f99a08c543d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086289 Aug 24 08:02:10.288106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 664/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:10.486755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:10.487309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:10.493669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.494222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.494655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.495331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.495773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.496186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.637098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.645649 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.647273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.648442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7325df64-72e6-4ffe-bf07-238ffd126d28 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1723 microversion: 2.20 time: 0.165678 Aug 24 08:02:10.649239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 632/1296] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:10 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:11.091450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.092057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.097961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.098440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.098868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.099554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.099999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.100419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.234252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.242041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e7cb135-1b0a-439e-a695-04af641d71c6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154445 Aug 24 08:02:11.242613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 665/1297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:11.309071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.309679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.315924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.316393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.316902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.320421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.321150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.321733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.460670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.469280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0268ab20-a1bc-4f73-bd47-98c795d56800 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.164334 Aug 24 08:02:11.469862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 633/1298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:11.672677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.672677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.676276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e35b86b-53d6-4c53-8c30-04f63a390278", "name": "network-vif-deleted", "tag": "bc89f8aa-a571-40af-a663-66aba4b33e72"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:11.678629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.679114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.679543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.681179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.681917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.682341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.687486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.689106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.689954 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.705372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] Creating event network-vif-deleted:bc89f8aa-a571-40af-a663-66aba4b33e72 for instance 4e35b86b-53d6-4c53-8c30-04f63a390278 on hv-cinder-85427 Aug 24 08:02:11.712800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-930061e2-bd6e-4cf4-aacd-dcfec04d5827 req-fb542001-3258-4ae1-b725-9d25253fd848 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040336 Aug 24 08:02:11.714174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 634/1299] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:11.766470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.777494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.779293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1858e633724d446dbbd128b317158d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4908cc2cf74047bcd5cc1771b28189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.780460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-61cdbd36-bed0-4249-9305-a88eb6620a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 200 len: 1655 microversion: 2.20 time: 0.112826 Aug 24 08:02:11.781129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 666/1300] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:12.263925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.265147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.271281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.271767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.272186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.272905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.273353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.273775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.416763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.424778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-646f887b-6ed7-481a-b73d-8db8db97422a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.164993 Aug 24 08:02:12.425355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 635/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:12.490669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.493632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.499323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.499946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.500384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.501106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.501573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.501974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.522131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:12.572907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.581505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7821c80e-39d0-4c87-b44e-387195ec93c2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.094633 Aug 24 08:02:12.585113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 667/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:12.803533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.804135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.810751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.811272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.811695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.812377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.812851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.813264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.829264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 HTTP/1.1 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:02:12.830898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:12.832598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '4e35b86b-53d6-4c53-8c30-04f63a390278'} Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:12.833559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:12.835105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.839857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:12.839857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72a05da9-ef52-40e8-9c1d-909ca9726047 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 404 len: 111 microversion: 2.20 time: 0.032874 Aug 24 08:02:12.839857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 636/1303] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:12.841759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b256bd6-df6a-499d-8068-05b587786a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '.version_select at 0x7f4562cdbdc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.929995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b256bd6-df6a-499d-8068-05b587786a4c tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581664317" status: 204 len: 0 microversion: 2.20 time: 0.092021 Aug 24 08:02:12.930713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 668/1304] 10.222.0.26 () {60 vars in 1259 bytes} [Wed Aug 24 08:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581664317 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:02:13.447958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.448501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.454885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.455351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.455772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.456475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.456933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.457344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.602491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.603088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.609567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.610041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.610470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.611146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.611590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.612000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.622338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.631603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ba232e96-59d5-44a5-8071-21aa76c8ef59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.187551 Aug 24 08:02:13.643348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 637/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:13.682648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.691458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f9d1f29-6490-43b1-a7c2-1719af2baef2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.093271 Aug 24 08:02:13.692299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 669/1306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:13.749763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.750243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.756225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.756718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.757144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.757837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.759036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.759422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.772424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 HTTP/1.1 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:02:13.774160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.775893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '4e35b86b-53d6-4c53-8c30-04f63a390278'} Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:13.776794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.778218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.779698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:13.779698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d4d571fa-7996-4a37-a9e7-921ff0c6dff8 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 404 len: 111 microversion: 2.20 time: 0.029588 Aug 24 08:02:13.779698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 638/1307] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 24 08:02:13 2022] DELETE /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:13.783990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.784595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 4e35b86b-53d6-4c53-8c30-04f63a390278] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.790914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.791387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.791820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.792499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.792983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.793401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.807188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 HTTP/1.1 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:02:13.808904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.810561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '4e35b86b-53d6-4c53-8c30-04f63a390278'} Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:13.811452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. Aug 24 08:02:13.812959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.814248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 4e35b86b-53d6-4c53-8c30-04f63a390278 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:13.814248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a5bad7d-6162-4657-84bc-0f4d03f04c50 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278" status: 404 len: 111 microversion: 2.20 time: 0.030116 Aug 24 08:02:13.814248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 670/1308] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/4e35b86b-53d6-4c53-8c30-04f63a390278 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 08:02:13.818821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.819306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.825958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.826422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.826851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.827517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.827955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.828363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.841470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 HTTP/1.1 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:02:13.842968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.844632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '0e0e3ad6-3c71-43d7-921a-b1799ac33883'} Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:13.845451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.846660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.847828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:13.847828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3bc4298f-e8d8-4c3b-bd02-97a5df188a84 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 404 len: 111 microversion: 2.20 time: 0.029566 Aug 24 08:02:13.847828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 639/1309] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 24 08:02:13 2022] DELETE /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:13.852516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.853141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] [instance: 0e0e3ad6-3c71-43d7-921a-b1799ac33883] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.858963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.859424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.859843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.860511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.860989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.861401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.876547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] HTTP exception thrown: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Request method failure captured: Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 HTTP/1.1 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdnwkaQZAByrA1yfj8N4tUX5rFyp4CxLE9PJ9p7i2v-Z9-DpGGCk_VfBYKUxIA2CLFABIbahGdH2qjlG7l20Tw_2_9OILcAgBfGnK5YDVLxb-WWmDk7toQSjjlbG-QKZ099HzNKOiZj7Eb_J5uLHdYCQ3fwcD37jHQ5BxNItJzuPrCs Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:02:13.878057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7f4908cc2cf74047bcd5cc1771b28189"}]}] Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 7f4908cc2cf74047bcd5cc1771b28189 Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-59850250 Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 1858e633724d446dbbd128b317158d3f Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-59850250-project Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.879784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '0e0e3ad6-3c71-43d7-921a-b1799ac33883'} Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:13.880722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. Aug 24 08:02:13.882190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:02:13.884043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] Returning 404 to user: Instance 0e0e3ad6-3c71-43d7-921a-b1799ac33883 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:13.884043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-65877c32-e8fe-422b-ba75-0176cd7a6800 tempest-AttachVolumeShelveTestJSON-59850250 tempest-AttachVolumeShelveTestJSON-59850250-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883" status: 404 len: 111 microversion: 2.20 time: 0.030649 Aug 24 08:02:13.884043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 671/1310] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/0e0e3ad6-3c71-43d7-921a-b1799ac33883 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:14.654160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:14.654794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:14.661846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.662319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.662747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.663433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.663877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.664289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.713880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:14.714570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:14.721469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.721938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.722363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.723041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.723481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.723896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.790713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:14.798529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e8e6c48-e09c-4674-ae11-bbf81fc4f8f1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089171 Aug 24 08:02:14.799098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 672/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:14.890878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:14.898674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b97364b2-96cb-4a8f-8c26-b8ce60e46c59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.248325 Aug 24 08:02:14.899786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 640/1312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:15.819486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:15.820094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:15.826607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.834703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.834703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.834703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.834703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.835104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.890090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:15.898236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8f42e5e-e294-47b3-b918-a74928febeb1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082591 Aug 24 08:02:15.899706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 673/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:15.920160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:15.920880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:15.927246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.931567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.931567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.931567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.931567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.932149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.165772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.173580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-450089ee-74ed-4f6f-8697-4409ad7a7baa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.257254 Aug 24 08:02:16.174148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 641/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:16.920144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:16.920775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:16.927193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.927661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.928089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.928860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.929321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.932233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.998605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.006778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6fc318d7-a006-4994-9381-c1b6a937a80f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090478 Aug 24 08:02:17.007679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 674/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:17.197890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:17.199149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:17.208721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.209225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.209661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.210400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.210848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.211294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.361027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.363473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:17.369886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d7e4800c-1178-4c2c-9a2e-70ece06924c2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.179252 Aug 24 08:02:17.370448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 642/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:18.028595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.029173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:18.035575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.036044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.036470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.037179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.037624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.038105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.105693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.113613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dfcadcf3-ff9b-4f4f-bcf5-0cbe42cd30ba tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089363 Aug 24 08:02:18.114218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 675/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:18.391685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.392297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:18.399069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.399538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.399963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.400635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.401096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.401509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.533848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.542912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dbf23a9d-0513-408c-af2a-468ef7deda75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155371 Aug 24 08:02:18.547984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 643/1318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:19.136705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:19.137816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:19.144830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.145293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.145722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.146409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.146850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.147262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.227838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.235734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6196ac2-7a10-4854-8f7f-86a317a51f8c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.104698 Aug 24 08:02:19.244520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 676/1319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:19.567270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:19.572945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:19.577326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.577807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.578228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.578912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.579391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.579803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.720152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.727848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-12aaa87b-3f30-4e94-a211-bd0493db35fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.164421 Aug 24 08:02:19.728426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 644/1320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:20.264577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:20.265311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:20.271381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.271853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.272278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:20.273009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.273452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.273875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:20.360383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:20.368231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-574ceb54-9609-46eb-97a8-1f3b47e40a7c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.107779 Aug 24 08:02:20.368963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 677/1321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:20.748225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:20.748860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:20.755807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.756276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.756731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:20.757408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.757846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.758256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:20.891110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:20.899083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7a87cf6c-a1c6-4d2a-b59c-1a8a079d032c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154639 Aug 24 08:02:20.900327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 645/1322] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:21.390095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:21.390678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:21.396976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:21.397446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:21.398073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:21.398895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:21.399220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:21.399751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:21.461835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:21.469995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1918a848-175a-4142-90cb-81d0c02de1d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083938 Aug 24 08:02:21.470562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 678/1323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:21.921868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:21.922476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:21.929144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:21.929616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:21.930039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:21.930706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:21.931148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:21.931847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:22.084716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:22.092942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fab0c71d-ea7d-47e9-93f3-0c0e1edcec11 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.175009 Aug 24 08:02:22.093507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 646/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:22.496672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:22.497369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:22.503849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:22.504319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:22.504805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:22.507826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:22.507826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:22.507826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:22.580503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:22.589101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e0d92796-f01a-41a4-a193-e9f69d6218a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.096311 Aug 24 08:02:22.589702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 679/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:23.114517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:23.115110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:23.122120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.122624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.123078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.123790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.124231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.124667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.274157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:23.282478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ddc013ec-34f3-4087-bb12-a37e0afe6037 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.171781 Aug 24 08:02:23.283063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 647/1326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:23.610502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:23.611099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:23.617808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.618288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.618740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.619744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.620195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.620606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.684165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:23.692091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f08a9f6-22b6-4588-84ca-1ba59eecc248 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085572 Aug 24 08:02:23.692933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 680/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:24.303310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:24.303915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:24.311678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.312153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.312603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.313314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.313757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.314168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.448412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:24.456573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bcf51205-5416-4175-b836-2ab2efa1d68a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157119 Aug 24 08:02:24.457183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 648/1328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:24.713565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:24.714744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:24.717083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:24.721782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.722416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.722697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.723399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.723850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.724271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.789891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:24.798762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6589e884-26f1-4024-ac01-a9850d0187d6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089625 Aug 24 08:02:24.799341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 681/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:25.478100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:25.478808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:25.485495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.485973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.486403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.487093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.487537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.487981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.719188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:25.727177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-310aa56b-8e7d-42c8-b1a1-7449bfb3b953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.253156 Aug 24 08:02:25.727771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 649/1330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:25.821295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:25.822645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:25.829676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.830164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.830601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.831293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.831741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.832159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.894551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:25.902845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0502d391-5e46-438a-9121-76dac275801e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086993 Aug 24 08:02:25.903417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 682/1331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:26.748558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:26.749210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:26.751506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:26.756308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.756908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.757340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.758102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.758548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.758965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.924789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:26.925572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:26.932190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.932879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.933376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.934090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.934557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.934972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.955651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:26.964135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a69d6c60-9c31-4ed3-acb4-807c86f60a7a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.219376 Aug 24 08:02:26.964732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 650/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:26.997906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:27.005836 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa423da9-ec10-4c3d-952e-bb69870ed268 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085680 Aug 24 08:02:27.006596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 683/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:27.985242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:27.985856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:27.992319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:27.992832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:27.993265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:27.993948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:27.994485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:27.994906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:28.028449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:28.029119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:28.035595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:28.036384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:28.036841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:28.038076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:28.038531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:28.038977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:28.109298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:28.117219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4d4a56e2-3246-4fbf-8ff9-0450d7bf9c51 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.093859 Aug 24 08:02:28.117792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 684/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:28.143031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:28.151532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-773ea501-15d5-4263-9ae0-582558e88a79 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.170186 Aug 24 08:02:28.152101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 651/1335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:29.138091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:29.138632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:29.145005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.145501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.145927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.146598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.147040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.147451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.173454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:29.174114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:29.180631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.181805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.182240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.182942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.183389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.183802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.213366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:29.221641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5461f194-7406-4989-b6ac-5d27f66b66af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087543 Aug 24 08:02:29.222302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 685/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:29.316125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:29.324998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cbab3035-f876-4a28-b50b-1145cb869d43 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155345 Aug 24 08:02:29.325566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 652/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:30.241599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:30.242153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:30.249257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.249729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.250157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.250827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.251269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.251683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.270234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:30.314918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:30.324268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d04e14e0-4716-414e-bae4-2c593cbadae3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086562 Aug 24 08:02:30.324856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 686/1338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:30.345703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:30.346306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:30.352575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.353779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.354271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.354945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.355389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.355804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.490388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:30.498770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c3b89fc0-73fe-4330-a892-b5d9bb1fafc6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156837 Aug 24 08:02:30.499274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 653/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:31.344857 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:31.345460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:31.351823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.352291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.353268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.353950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.354420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.354919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.415927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:31.423549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5d4626e6-219e-4438-af3a-269cc450d68c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082667 Aug 24 08:02:31.424105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 687/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:31.520105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:31.520631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:31.527172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.527644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.528071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.528784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.529278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.529696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.661067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:31.668810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf64a2b3-8501-421d-8da0-7cff25a2b6fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152546 Aug 24 08:02:31.669371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 654/1341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:32.445469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:32.446176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:32.452796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.453271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.453701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.454407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.454850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.455262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.514993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:32.522678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bbb7aaef-b703-4e14-b79e-027d37dea356 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081359 Aug 24 08:02:32.523237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 688/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:32.689592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:32.690206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:32.697518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.697990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.698421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.699142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.699590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.700009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.832511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:32.841143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-15cc0f51-e0a7-4cc7-86be-115c556aab75 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155494 Aug 24 08:02:32.841722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 655/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:33.543509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:33.543961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:33.550585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:33.551073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:33.551509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:33.552321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:33.552827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:33.553255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:33.617204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:33.625190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-74bf9168-6e3e-4cec-b9ee-b9fc31d47b47 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085780 Aug 24 08:02:33.625763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 689/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:33.861413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:33.862024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:33.868544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:33.869065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:33.869500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:33.870185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:33.870657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:33.871090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:34.006701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:34.016152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dc8497c5-30a1-4afc-959d-8415ee5bf81d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157375 Aug 24 08:02:34.016152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 656/1345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:34.646498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:34.647099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:34.653510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:34.653997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:34.654402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:34.655068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:34.655519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:34.655917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:34.719558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:34.727362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1979a213-c32e-483c-808e-2b780754d7db tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084730 Aug 24 08:02:34.728087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 690/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:35.036547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:35.037185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:35.044447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.044988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.045431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.046172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.046608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.047026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.182935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:35.190889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c62ceb88-a037-40c3-90a4-fdd932acfbbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158100 Aug 24 08:02:35.191389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 657/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:35.747846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:35.748450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:35.754955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.755429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.755855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.756531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.757017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.757436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.818503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:35.826379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8ef82683-1e8f-427b-add9-6c6e3072717d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082996 Aug 24 08:02:35.826947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 691/1348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:36.213499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:36.214063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:36.220482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.220988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.221414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.222125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.222570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.222986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.356246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:36.363876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e5db4baf-561a-4890-b6fa-c9e4da8b4fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154852 Aug 24 08:02:36.364440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 658/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:36.847117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:36.847823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:36.854523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.855066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.855503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.856187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.856628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.857058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.918027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:36.925721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c38f144-ba92-4258-a30b-045eee11c79f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082436 Aug 24 08:02:36.926288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 692/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:37.385248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:37.385872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:37.392437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.392952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.393377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.394059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.394501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.394922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.409254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:37.525421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:37.533476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9a73f6a-e33b-4a1a-a1e1-7a4c861bde68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152534 Aug 24 08:02:37.534042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 659/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:37.947420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:37.948066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:37.954595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.955066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.955494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.956173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.956607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.957115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:38.020452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:38.029195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5a1df8ae-9bfa-4ddf-99eb-1f9dd0f3daab tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086381 Aug 24 08:02:38.029757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 693/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:38.555261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:38.556549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:38.563027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:38.563492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:38.563914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:38.564591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:38.565059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:38.565472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:38.697442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:38.705105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3a8156a-1705-42b1-9373-bd4a628e06f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153636 Aug 24 08:02:38.705677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 660/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:39.050256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:39.050857 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:39.057439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:39.057910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:39.058332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:39.059009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:39.059451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:39.059859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:39.121067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:39.128668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7323b69-238e-493f-bf73-fae09deba28a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082316 Aug 24 08:02:39.129230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 694/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:39.726055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:39.726654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:39.733206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:39.733675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:39.734097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:39.734766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:39.735208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:39.735617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:39.871100 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:39.878828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3fa8f23c-6f77-4c42-bae4-ec44fbf47108 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156634 Aug 24 08:02:39.879380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 661/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:40.149901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:40.150445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:40.156904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:40.157379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:40.157809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:40.158493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:40.158939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:40.159355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:40.220553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:40.228766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f02a291-3e40-4eef-a009-38012ab6623d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082792 Aug 24 08:02:40.229331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 695/1356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:40.902545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:40.903224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:40.910394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:40.910819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:40.911243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:40.912099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:40.912718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:40.913145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:41.051560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:41.059396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2fecce38-17bb-4d39-a43c-c33fe367401e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.162339 Aug 24 08:02:41.059961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 662/1357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:41.250319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:41.250881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:41.257379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:41.257852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:41.258278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:41.259719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:41.260168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:41.260588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:41.320392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:41.328825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab680bc2-19a1-4ebb-b7b5-b2608c28e392 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082367 Aug 24 08:02:41.329423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 696/1358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:42.080904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:42.081513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:42.088346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:42.088849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:42.089282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:42.089967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:42.090547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:42.090966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:42.227270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:42.235934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-39b526cc-a494-407f-b4c7-152de96c589f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.159032 Aug 24 08:02:42.236498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 663/1359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:42.349320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:42.349923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:42.357231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:42.357699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:42.358124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:42.358794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:42.359235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:42.359644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:42.425228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:42.432788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9b86abe0-46fa-4909-b7ae-27d4252b1333 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087305 Aug 24 08:02:42.433350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 697/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:43.257033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:43.257632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:43.264266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:43.264771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:43.265197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:43.265867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:43.266305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:43.266716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:43.397283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:43.405714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6dc00abc-35f5-44ef-9fd1-b28c2450d570 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152401 Aug 24 08:02:43.406280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 664/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:43.454483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:43.455148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:43.461519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:43.462737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:43.463197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:43.463880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:43.464327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:43.464768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:43.525619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:43.533387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a6af71a-21e9-4d4d-8447-310fe7a9e84c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082764 Aug 24 08:02:43.533960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 698/1362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:44.426329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:44.426942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:44.433439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:44.433919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:44.434355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:44.435040 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:44.435496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:44.436058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:44.553948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:44.554568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:44.561173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:44.561657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:44.562086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:44.562969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:44.563419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:44.563837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:44.570219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:44.578179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2ac986e2-9f68-4cb7-a2ab-7139a525b248 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155704 Aug 24 08:02:44.578952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 665/1363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:44.626342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:44.634445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e67aabfd-4d13-4e24-be47-35bef84bac19 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084327 Aug 24 08:02:44.635151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 699/1364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:45.599316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:45.599913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:45.607352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:45.607823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:45.608249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:45.608951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:45.609391 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:45.609803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:45.655439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:45.656020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:45.662365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:45.662835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:45.663262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:45.663935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:45.664378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:45.665407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:45.726806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:45.735123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3e9b214c-73f0-4119-b685-1cb24c5a78d1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083458 Aug 24 08:02:45.735699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 700/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:45.741777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:45.749657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e0e92e58-f95e-487a-accf-93af149110eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154200 Aug 24 08:02:45.750214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 666/1366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:46.755749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:46.756353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:46.763621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:46.764102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:46.764531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:46.765303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:46.765760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:46.766181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:46.770331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:46.770934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:46.777637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:46.778121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:46.778538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:46.779217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:46.779659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:46.780071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:46.831534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:46.839380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b99a550b-e58b-4412-9698-e080034f5430 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087517 Aug 24 08:02:46.839957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 701/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:46.910389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:46.918565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc4c9c9b-ecea-4327-9bd3-57e6688fcc3a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152172 Aug 24 08:02:46.919122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 667/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:47.860678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:47.861275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:47.867697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:47.868352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:47.868894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:47.869590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:47.870035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:47.870451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:47.931304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:47.939192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-728992f3-aa1e-46dc-97aa-1442bd660299 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082472 Aug 24 08:02:47.941625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:47.942338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 702/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:47.942441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:47.947593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:47.948066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:47.948494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:47.949213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:47.949657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:47.950072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:48.086445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:48.094250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dafd155e-6f5f-45b3-8d73-742b2ec8551f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.158779 Aug 24 08:02:48.094819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 668/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:48.960540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:48.961141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:48.968348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:48.968854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:48.969278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:48.969952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:48.970395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:48.970808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:48.974628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:49.034328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:49.042877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-493b5f6c-3ae3-44e4-ab7e-1178dd145eb9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086129 Aug 24 08:02:49.043448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 703/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:49.115057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:49.115696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:49.122194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:49.122669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:49.123128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:49.123808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:49.124247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:49.124691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:49.256456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:49.264762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d71bc0c9-7df9-4bb7-a1b0-1c0a321543f9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153461 Aug 24 08:02:49.265315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 669/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:50.063926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:50.064508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:50.070900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:50.071368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:50.071790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:50.072459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:50.072924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:50.073334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:50.133563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:50.141332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-54d18319-b3e5-4815-b8bf-4608511fa68b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081209 Aug 24 08:02:50.141893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 704/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:50.286405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:50.287011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:50.294080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:50.294548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:50.294974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:50.295652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:50.296097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:50.296516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:50.432077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:50.440272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-863c18c8-05de-440f-87de-557376040a3e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157723 Aug 24 08:02:50.440869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 670/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:51.161993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:51.162680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:51.169372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.169851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.170280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.170964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.171417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.171904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.238391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:51.247268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-479c3b37-a0a5-426e-a874-f30239377e0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089267 Aug 24 08:02:51.247847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 705/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:51.461847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:51.462404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:51.469567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.470036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.470462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.471137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.471577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.472046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.602519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:51.610452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd166fd2-b7b2-4544-98cb-d480e31f2574 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152621 Aug 24 08:02:51.611041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 671/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:52.268282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:52.268910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:52.275376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:52.275852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:52.276280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:52.276997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:52.277443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:52.277863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:52.338416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:52.346419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-29ba6874-671a-4252-b274-691370b001fe tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082044 Aug 24 08:02:52.346986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 706/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:52.630591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:52.631272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:52.637735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:52.638206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:52.638633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:52.639315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:52.639789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:52.640204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:52.771930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:52.780333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e712fd52-1516-4bbe-8af6-c805624a9b47 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.153594 Aug 24 08:02:52.780932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 672/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:53.367580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:53.368181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:53.375121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.375613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.376020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.376745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.377187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.377598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.438772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:53.446623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c546822-7b73-46c8-bed1-4285a389562b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082930 Aug 24 08:02:53.447184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 707/1379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:53.802330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:53.802831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:53.810102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.810568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.810990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.811659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.812096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.812506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.945828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:53.953688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-20fd9d65-6848-4bb9-b2bb-259e906052e3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155284 Aug 24 08:02:53.954255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 673/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:54.468549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:54.469178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:54.475586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.476053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.476478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.477179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.477625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.478035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.538197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:54.546354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f1e24b54-dc1e-4795-a21f-4a3bf9ded8da tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082532 Aug 24 08:02:54.546919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 708/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:54.975267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:54.975873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:54.982590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.983062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.983494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.984171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.984617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.985058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.116070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:55.124383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-961ab10a-9abb-42b6-9c4f-b0784a248bf0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.152970 Aug 24 08:02:55.124983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 674/1382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:55.567851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:55.568460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:55.575135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:55.575612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:55.576067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.576890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:55.577344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:55.577809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.642448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:55.650247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f4bfb2f-ddcf-4ec8-aeb6-95396414ddd0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086580 Aug 24 08:02:55.650820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 709/1383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:56.145264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:56.145871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:56.153559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.154131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.154557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.155273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.155710 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.156117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.289824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:56.297745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1fda463c-a9cb-409b-9f27-96aaca4aa521 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.156330 Aug 24 08:02:56.298311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 675/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:56.672105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:56.672731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:56.679197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.679664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.680085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.680785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.681225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.681668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.744410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:56.752925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-57ae1b07-dd84-4841-8d02-59989454a1ce tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085469 Aug 24 08:02:56.753483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 710/1385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:57.319524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:57.320131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:57.322431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=52 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:57.327701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:57.328161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:57.328589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:57.329297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:57.329741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:57.330157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:57.334062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:57.464729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:57.472508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96188e26-a478-4215-baae-90344d5fad58 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157144 Aug 24 08:02:57.473113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 676/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:57.773678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:57.774200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:57.776444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=60 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:57.781494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:57.781960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:57.782384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:57.783054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:57.783493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:57.783901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:57.846044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:57.854055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4640ece5-e0f1-47ea-9ac3-01ac95302a87 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084202 Aug 24 08:02:57.854899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 711/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:58.493522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:58.494137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:58.501014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.501493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.501926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.502614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.503061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.503479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.637358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:58.645086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd6f696c-0fc6-4e93-993a-69510e63a948 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155427 Aug 24 08:02:58.645646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 677/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:58.875897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:58.876498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:58.882922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.883695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.884421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.885126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.885567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.886605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.946759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:58.955332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f849f4e6-5502-486b-9afc-9af4f88b6768 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083568 Aug 24 08:02:58.955891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 712/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:59.666934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:59.667544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:59.674517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:59.674993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:59.675425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:59.676108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:59.676557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:59.677014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:59.805919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:59.814475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d00ec040-8d51-480d-be9d-5c033c6501b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151393 Aug 24 08:02:59.815042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 678/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:59.976087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:59.976744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:59.983957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:59.984427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:59.984886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:59.985564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:59.986009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:59.986423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.050355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:00.065399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e3f4f4f1-c367-41cf-a1e9-4dd93ec12006 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085956 Aug 24 08:03:00.065399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 713/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:00.835604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:00.836205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:00.843181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.843645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.844066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.844763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.845203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.845613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.973331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:00.981615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1f55891c-b847-4639-ace4-e9530c73ea0a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149053 Aug 24 08:03:00.982170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 679/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:01.079648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:01.080252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:01.086707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:01.087124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:01.087550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:01.088233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:01.088699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:01.089124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:01.149498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:01.157999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-61e8bdc7-02d3-44c9-a728-d52563299f12 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082263 Aug 24 08:03:01.158562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 714/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:02.002565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:02.003238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:02.009361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:02.009836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:02.010265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:02.010943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:02.011387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:02.012295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:02.147997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:02.155926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2cca5dc2-790e-48ed-a493-7c7d26937689 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157463 Aug 24 08:03:02.156504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 680/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:02.179116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:02.179722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:02.186999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:02.187473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:02.187902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:02.188583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:02.189057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:02.189477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:02.249659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:02.257296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8caad07-eeff-466a-bbde-d5acaffab4af tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082059 Aug 24 08:03:02.257796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 715/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:03.176977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:03.177572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:03.184012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:03.184487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:03.184941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:03.185617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:03.186064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:03.186474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:03.278933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:03.279528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:03.285846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:03.286317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:03.286736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:03.287411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:03.287850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:03.288267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:03.315864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:03.323852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4069d04d-0d80-45eb-9ff1-6476b7789a41 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.150868 Aug 24 08:03:03.325126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 681/1396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:03.352683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:03.360710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-23da5f9b-a054-4062-b81e-ed0070755d0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086092 Aug 24 08:03:03.361281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 716/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:04.345152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:04.345766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:04.354445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.355165 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.356335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.357476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.358184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.358606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.380168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:04.380790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:04.387954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.388428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.388882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.389561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.390001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.390411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.464305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:04.474169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fde89b62-69ec-47f2-8968-80300ae9c497 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.097665 Aug 24 08:03:04.474751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 717/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:04.509757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:04.519679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f951c80-f0a0-4692-9ae5-1bfab110fb4b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.178038 Aug 24 08:03:04.520608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 682/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:05.495391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:05.495956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:05.503115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:05.503586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:05.504007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:05.504702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:05.505168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:05.505581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:05.541869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:05.542468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:05.549452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:05.549920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:05.550341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:05.551028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:05.551462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:05.551875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:05.572073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:05.579869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9b342f0-0c38-4443-8fc5-565970be26b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.088367 Aug 24 08:03:05.580549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 718/1400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:05.684541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:05.692739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-88dd39ed-2e20-4c7e-b95c-db592acd6845 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.154550 Aug 24 08:03:05.693303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 683/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:06.600913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:06.601584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:06.608481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:06.609000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:06.609455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:06.610242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:06.610693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:06.611113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:06.673687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:06.677159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:06.681732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f9b2c52e-d50c-4c4c-a94c-b6e6b0790f00 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084818 Aug 24 08:03:06.682299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 719/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:06.713348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:06.714045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:06.721015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:06.721480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:06.721902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:06.722570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:06.723006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:06.723415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:06.852506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:06.861004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dd6984d1-e7e5-4cc7-b376-c880cdd716f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151453 Aug 24 08:03:06.861563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 684/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:07.704417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:07.704970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:07.711297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.711772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.712197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:07.712903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.713351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.713762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:07.774386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:07.782152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4559178c-b88b-49f0-b562-d00670373dfc tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082742 Aug 24 08:03:07.782721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 720/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:07.882056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:07.882665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:07.889106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.889583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.890011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:07.890693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.891144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.891593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:08.025632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:08.033410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-94f44fb8-c0c2-42bb-8220-95daa46637d9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155286 Aug 24 08:03:08.037645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 685/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:08.802633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:08.803167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:08.810413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:08.810896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:08.811326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:08.812037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:08.812481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:08.812927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:08.876077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:08.883846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-17096040-9898-4f09-98ea-ef6fc92e5422 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085155 Aug 24 08:03:08.884402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 721/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:09.056457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:09.057163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:09.063642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.064112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.064545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.065248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.065693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.066106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.200305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:09.208031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-455423df-477c-418e-9434-6f6f255841b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155440 Aug 24 08:03:09.208587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 686/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:09.904616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:09.905245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:09.911592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.915472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.915472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.915472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.915472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.915849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.974595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:09.983379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a5e0a009-f572-4166-9f88-99ee96e19cec tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082743 Aug 24 08:03:09.988324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 722/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:10.229166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:10.229708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:10.236717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:10.237194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:10.237623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:10.238303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:10.238745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:10.239161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:10.371645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:10.380330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d7e003a2-ba9b-40a8-8bb3-74cf64936495 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.155035 Aug 24 08:03:10.380931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 687/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:11.005128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:11.005737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:11.013067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.013543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.013972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:11.014651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.015100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.015517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:11.082946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:11.091569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a2fa9ea1-2b61-4d5a-89ab-b01f1e65828a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090317 Aug 24 08:03:11.092139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 723/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:11.400205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:11.400885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:11.406861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.407426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.407849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:11.408554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.409017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.409432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:11.540433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:11.548168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d51a6599-32c9-4703-a096-70775a5e5ea5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151833 Aug 24 08:03:11.548747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 688/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:12.111655 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:12.112323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:12.118888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:12.119354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:12.119777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:12.120442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:12.120918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:12.121329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:12.182344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:12.190408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0b7be1df-d334-46f4-9f09-d40f9f95ad57 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082666 Aug 24 08:03:12.190967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 724/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:12.570181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:12.570782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:12.577228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:12.577718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:12.578141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:12.578812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:12.579248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:12.579656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:12.715140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:12.723149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c435595e-cd9c-4d8d-913e-9b28f1758bf9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.157099 Aug 24 08:03:12.724613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 689/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:13.212340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:13.212959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:13.219303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.219775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.220199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.220902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.221372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.221788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.284936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:13.292530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-800e5471-11a1-4810-9178-9303c683597b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084000 Aug 24 08:03:13.293137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 725/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:13.744513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:13.745162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:13.751536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.751998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.752417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.753122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.753563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.753971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.882478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:13.890594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a0746499-47c1-43f8-8c4b-f398c23b7879 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.149920 Aug 24 08:03:13.891150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 690/1415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:14.314373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:14.314986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:14.321848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.322333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.322765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:14.323453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.323896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.324308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:14.385364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:14.393778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-47124059-51c6-40b7-b2a9-62ee62bfbee3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083268 Aug 24 08:03:14.394337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 726/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:14.912344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:14.912936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:14.920148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.920624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.921078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:14.921783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.922233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.922653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:15.051738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:15.059545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-54ff68f5-4269-4965-83a7-63f328451b5b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.151235 Aug 24 08:03:15.060109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 691/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:15.414494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:15.415192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:15.421686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:15.422166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:15.422594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:15.423278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:15.423725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:15.424140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:15.486217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:15.493991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5fd513dd-aaae-4228-ab60-4826e819c8a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083337 Aug 24 08:03:15.494553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 727/1418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:16.048746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:16.049695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:16.063833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.064530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.065048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.065815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.066319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.067055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.094408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:03:16.097650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:16.185603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:16.195185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.198235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.198235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.208167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] Creating event network-changed:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 08:03:16.213434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-74937041-f4af-4218-bfc9-1ddc0ae1515a req-58025e12-3e59-457c-83fb-2ae64b5271a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162660 Aug 24 08:03:16.214027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 728/1419] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:16.369857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-93c06931-ffcf-4159-a677-fbf17a9a12a2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 204 len: 0 microversion: 2.1 time: 0.325277 Aug 24 08:03:16.374321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 692/1420] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:03:16 2022] DELETE /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:03:16.380989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:16.381786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:16.388912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.389478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.390078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.390766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.391280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.391826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.516172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:16.517470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:16.523912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.524550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.525303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.526105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.531983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.532713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.549114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:16.562486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8d7cfd5-5562-4b74-b8fd-1874058e94c7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1569 microversion: 2.1 time: 0.186552 Aug 24 08:03:16.565402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 729/1421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:16.646659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:16.655569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-22a79026-663a-41f5-bdb2-ca3650d6d2a7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.144193 Aug 24 08:03:16.656406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 693/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:17.586704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:17.587311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:17.593828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.594311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.594732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.595410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.595849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.596260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.676981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:17.677592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:17.684827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.685311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.685759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.686461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.686905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.687324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.729325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:17.737836 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-640865f8-3204-43e9-9fb7-c6572e0f02b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154927 Aug 24 08:03:17.738446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 730/1423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:17.752829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:17.760514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7a0fcbda-a0e6-4487-ac2f-9e73a4544390 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087665 Aug 24 08:03:17.761115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 694/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:18.759201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:18.759808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:18.767154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.767630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.768053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.768787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.769273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.769688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.781569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:18.782165 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:18.788579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.789019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.789441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.790111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.790549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.790958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.855451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:18.863377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-133592ce-7f44-499e-a002-cfc20f86965e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085864 Aug 24 08:03:18.864115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 695/1425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:18.901916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:18.909751 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d388ece7-57a0-4210-b511-da6832293ed6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154406 Aug 24 08:03:18.910326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 731/1426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:19.884382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:19.885007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:19.893041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.893510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.893935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.894635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.895079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.895489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.930819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:19.931580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:19.938191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.938673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.939105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.939855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.940528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.940790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.961783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:19.970668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-85b2f1f5-5d66-4089-b832-4888eb99950e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090053 Aug 24 08:03:19.971243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 696/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:20.077639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:20.085311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c3d20125-72ae-4d12-8a92-0165f08d56f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.158600 Aug 24 08:03:20.085913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 732/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:20.991277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:20.991883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:20.998346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.998815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.999241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.999917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.000360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.000812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.061177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:21.068974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-31c427a1-3637-417b-b2a3-a82b5f78343e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081511 Aug 24 08:03:21.069543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 697/1429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:21.107100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:21.107706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:21.114105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.114580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.115011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.115692 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.116132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.116549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.244282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:21.252839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0e7f2284-8a4d-41a7-bd00-7763588b9a9e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150204 Aug 24 08:03:21.253401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 733/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:22.089159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:22.089769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:22.096262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.096765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.097199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.097887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.098365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.098786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.161737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:22.169979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e135df2c-fa94-4f03-aa2e-4b2bd14a9d18 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084654 Aug 24 08:03:22.170485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 698/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:22.273738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:22.274347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:22.281218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.281693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.282125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.282815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.283445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.283867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.634081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:22.641840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ac63213-44c2-4190-b5f7-575d78871b24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.372009 Aug 24 08:03:22.642406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 734/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:23.190625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:23.191507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:23.197994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.198460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.198883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.200044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.200483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.200927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.261192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:23.269471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-31c1267a-8e00-4a1c-badd-72e2efe1bcfb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082640 Aug 24 08:03:23.270031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 699/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:23 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:23.662157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:23.662780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:23.669548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.670022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.670443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.671117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.671555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.671964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.805149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:23.813693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c2781a5-dc64-4669-b1d8-aa9836187d62 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155396 Aug 24 08:03:23.814257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 735/1434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:24.290087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:24.290752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:24.297879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.298352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.298805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.299484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.299927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.300345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.361241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:24.368927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84de963b-2244-4835-b871-a736863cb5e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082651 Aug 24 08:03:24.369493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 700/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:24.835253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:24.835850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:24.843068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.843548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.843973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.844663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.845107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.845516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.977252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:24.985207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-682f333b-0f10-4c85-af39-37550c5644eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153824 Aug 24 08:03:24.985781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 736/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:25.390410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:25.391019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:25.397605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:25.398082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:25.398515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.399223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:25.399656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:25.400074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.464638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:25.472304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4ebc2e60-e746-4da5-baab-0b58a9b68889 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086608 Aug 24 08:03:25.472901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 701/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:25.972722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:25.973242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:25.979553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:25.980022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:25.980462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.982032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:25.982475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:25.982888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.986858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:26.006696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:26.007303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:26.009246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:03:26.013286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.013760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.014185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.014867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.015308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.015720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.148757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.compute.api [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Instance is already in deleting state, ignoring this request Aug 24 08:03:26.149604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d974a614-e307-47c4-a1b7-e0d557d6d395 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "DELETE /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 204 len: 0 microversion: 2.1 time: 0.180852 Aug 24 08:03:26.150189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 737/1438] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:03:25 2022] DELETE /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:03:26.150414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:26.158890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:26.159175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e2f88a2a-e2eb-4a91-97f9-30c9c3a9e006 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156306 Aug 24 08:03:26.159493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:26.159753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 702/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:26.165431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.165958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.166402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.167112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.167564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.168072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.229444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:26.237265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4e105f75-89b4-4bcb-ad3e-9c5e7e824d76 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082228 Aug 24 08:03:26.237835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 738/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:27.179302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:27.179860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:27.187236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.187708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.188160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.188872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.189312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.189722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.258627 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:27.259242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:27.265806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.266404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.266730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.268819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.269300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.269733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.321451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:27.330436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c1aecf96-5ecf-48c5-a125-907644aa50f4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154543 Aug 24 08:03:27.330848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 703/1441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:27.332901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:27.341288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-57c07721-af8a-4fe0-8bc6-427ad7ce2d77 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086578 Aug 24 08:03:27.341844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 739/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:27 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:28.351327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:28.351942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:28.354387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:28.359884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:28.360364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:28.360827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:28.361521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:28.361972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:28.362254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:28.362676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:28.362885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:28.366332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=58 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:28.369849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:28.370312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:28.370736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:28.371697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:28.372563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:28.373012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:28.436497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:28.444529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f15a622c-9a15-4e02-aece-6a8aec20e63b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086030 Aug 24 08:03:28.445133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 740/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:28.498910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:28.506520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ad0d8949-c40e-4331-b93a-79c70a2ad1f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.159017 Aug 24 08:03:28.507094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 704/1444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:29.466082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:29.466687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:29.473120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:29.473593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:29.474022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:29.474702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:29.475146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:29.475562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:29.527858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:29.528477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:29.535049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:29.535530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:29.535960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:29.536674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:29.537126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:29.537542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:29.540367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:29.548880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-963483bc-79a0-4594-bed8-71298cef2c16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086797 Aug 24 08:03:29.549445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 741/1445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:29.668600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:29.676899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4530fdb6-3c84-4eaf-b79f-35eb3444ac1a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153391 Aug 24 08:03:29.677671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 705/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:30.570141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:30.570737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:30.578118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:30.578580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:30.579004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:30.579702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:30.580170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:30.580579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:30.641922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:30.649500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-791ad205-866d-4f9a-9921-92087a31f977 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083440 Aug 24 08:03:30.650064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 742/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:30.697849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:30.698458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:30.705009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:30.705485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:30.705914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:30.706594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:30.707039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:30.707457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:30.835772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:30.843628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a1734b5f-0298-41ef-9dea-d89480d5a910 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.149567 Aug 24 08:03:30.844191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 706/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:31.670427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:31.671025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:31.677440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:31.677908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:31.678337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:31.679004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:31.679448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:31.679856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:31.742743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:31.750948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-024288a0-f758-45e7-8621-32272a6403c5 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084392 Aug 24 08:03:31.751510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 743/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:31.864778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:31.865289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:31.872070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:31.872533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:31.872980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:31.873659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:31.874098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:31.874507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:32.007516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:32.009729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:32.016562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-53e333c4-8551-438a-97a8-56f58ca9f1ae tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155643 Aug 24 08:03:32.017166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 707/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:32.772544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:32.773159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:32.780015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:32.780481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:32.780940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:32.781607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:32.782044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:32.782451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:32.994758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:33.002367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-28d0f395-48e7-4ab4-8be8-3362e1668c74 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.233970 Aug 24 08:03:33.002924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 744/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:33.037937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:33.038485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:33.045508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:33.045986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:33.046421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:33.047129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:33.047579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:33.047998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:33.179707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:33.187630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76ab24f1-6af8-4c81-b80e-38fe6fa4fca3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154027 Aug 24 08:03:33.188187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 708/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:34.023490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:34.024568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:34.031492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:34.031962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:34.032387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:34.033215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:34.033641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:34.034052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:34.098452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:34.106999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0a895dcb-25f8-4eb5-ab34-9aa9c21e415b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087300 Aug 24 08:03:34.107557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 745/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:34 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:34.209250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:34.209852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:34.217086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:34.217555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:34.217980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:34.218676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:34.219116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:34.219520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:34.351669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:34.360246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76666fa3-3366-4f18-89e8-52bd93bba348 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154750 Aug 24 08:03:34.360850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 709/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:35.129177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:35.129764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:35.136354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:35.136858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:35.137409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:35.137999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:35.138449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:35.138909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:35.202472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:35.210203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0bc2bc5e-675b-410a-9bec-230efe9abae2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085471 Aug 24 08:03:35.210760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 746/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:35.381157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:35.381838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:35.388232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:35.388732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:35.389291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:35.389979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:35.390431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:35.390853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:35.518761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:35.526528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8319db85-7496-4eae-8988-10ad0851d23d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.149315 Aug 24 08:03:35.527101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 710/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:36.230765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:36.231396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:36.237914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:36.238391 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:36.238822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:36.239507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:36.239954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:36.240379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:36.300105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:36.307803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-238b9884-4407-4828-9a74-00f74d2bea50 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080884 Aug 24 08:03:36.308354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 747/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:36.547507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:36.548110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:36.554858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:36.555378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:36.555800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:36.556471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:36.556950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:36.557365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:36.688380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:36.696553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-334cd995-33e0-4403-a138-a3ef958d6e6f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153002 Aug 24 08:03:36.697146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 711/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:37.330380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:37.331035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:37.337426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:37.337900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:37.338458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:37.339144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:37.339592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:37.340011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:37.402076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:37.410416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a25abf8d-c83a-4cf5-bbe7-16b98945a415 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084744 Aug 24 08:03:37.410974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 748/1459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:37.717362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:37.718028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:37.724443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:37.724947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:37.725375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:37.726056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:37.726501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:37.726915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:37.857623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:37.865226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6a5535b-2e6b-4539-b18c-73ca2434a1ab tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151711 Aug 24 08:03:37.865792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 712/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:38.431502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:38.432109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:38.439359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:38.439829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:38.440257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:38.441215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:38.441670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:38.442083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:38.505034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:38.512686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-47e78dc9-5b7e-4438-89f4-f3e00ff23e01 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085117 Aug 24 08:03:38.513245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 749/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:38.886387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:38.886996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:38.894071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:38.894544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:38.894972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:38.895652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:38.896092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:38.896504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:39.026042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:39.034502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-934112c1-1bff-47d9-9c55-8eb77f38eabb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152052 Aug 24 08:03:39.035076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 713/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:39.533993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:39.534602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:39.541128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:39.541601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:39.542028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:39.542846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:39.543289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:39.543704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:39.606670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:39.614990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f064cd97-6f7d-4b07-9636-c8162d1f5abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085172 Aug 24 08:03:39.615550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 750/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:40.055129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:40.055740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:40.062187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:40.062663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:40.063097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:40.063782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:40.064234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:40.064672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:40.451520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:40.460093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-89f4cb8a-54e8-40c0-912c-2fe969cca7a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.408842 Aug 24 08:03:40.460662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 714/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:40.636349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:40.636981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:40.644071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:40.644547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:40.645002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:40.645677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:40.646119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:40.646535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:40.707874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:40.715577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8df25102-77bf-45c1-9a55-f90c67721779 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083027 Aug 24 08:03:40.716132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 751/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:41.481880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:41.482484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:41.489107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:41.489578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:41.490005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:41.490701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:41.491124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:41.491538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:41.620022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:41.628215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-43dcba3f-199f-4a66-b213-fc6743d1752c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150376 Aug 24 08:03:41.628809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 715/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:41.736985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:41.737541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:41.743938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:41.744418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:41.744888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:41.745581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:41.746032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:41.746455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:41.764015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:41.807942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:41.815704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-154ff2a1-4744-4991-b2cc-d1e5ebb205fb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083496 Aug 24 08:03:41.816521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 752/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:41 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:42.649087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:42.649678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:42.656269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:42.656795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:42.657226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:42.657906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:42.658347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:42.658760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:42.792673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:42.800874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-555119a0-1c33-4f12-bb11-0804a6e3e0e5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155567 Aug 24 08:03:42.803027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 716/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:42.836636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:42.837265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:42.844178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:42.844663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:42.845096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:42.845776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:42.846219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:42.846633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:42.910231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:42.917965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5bcf1041-52a0-486b-802b-1b3f07e903c3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085126 Aug 24 08:03:42.918598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 753/1469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:43.125787 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:03:43.126010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:03:43.822399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:43.823034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:43.830150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:43.830614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:43.831037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:43.831713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:43.832184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:43.832594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:43.939774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:43.940366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:43.947096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:43.947565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:43.947999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:43.948717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:43.949171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:43.949607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:43.962614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:43.970707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ebc1ffd6-03e4-465e-a26a-c48c0780712b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152048 Aug 24 08:03:43.971470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 717/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:44.012055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:44.020793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-66a6a392-c12c-4c30-b0f3-4dc9abdcfc7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085443 Aug 24 08:03:44.021350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 754/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:44.991033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:44.991639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:44.998140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:44.998613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:44.999044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:44.999722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:45.000162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:45.000585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:45.041664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:45.042404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:45.048988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:45.049465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:45.049903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:45.050596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:45.051046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:45.051466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:45.112666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:45.120456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0708bf27-afaa-4ca4-a2f9-2d133eb6c377 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082681 Aug 24 08:03:45.121050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 755/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:45.135552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:45.144243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b708b6f-cdd3-45ea-9ec7-9add74010e04 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.157087 Aug 24 08:03:45.144824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 718/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:46.141902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:46.142503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:46.148889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:46.149367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:46.149798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:46.150482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:46.150930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:46.151344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:46.165866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:46.166507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:46.173674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:46.174149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:46.174578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:46.175265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:46.175709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:46.176124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:46.215461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:46.224132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36b1d9ad-97ba-4d9c-8ebc-4e975bc6f432 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086219 Aug 24 08:03:46.224725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 756/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:46 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:46.306779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:46.314731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-55c45a54-a2e8-4f9a-805c-b995248011c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152706 Aug 24 08:03:46.315298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 719/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:47.245449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:47.246053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:47.253241 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:47.253724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:47.254155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:47.254840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:47.255287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:47.255732 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:47.318514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:47.326354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5377d91-abb6-44cb-812b-c0e4f44a76c4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084804 Aug 24 08:03:47.326914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 757/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:47.335814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:47.336422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:47.342832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:47.343299 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:47.343726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:47.344397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:47.347127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:47.347127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:47.474763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:47.482456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-60d43d74-a720-4cf9-a772-ae09860ac498 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150531 Aug 24 08:03:47.483015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 720/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:48.347024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:48.347815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:48.354283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:48.354817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:48.355244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:48.355927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:48.356369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:48.356826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:48.417280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:48.425786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bacecaed-b3f9-431d-8669-aa2cbbe080a8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082283 Aug 24 08:03:48.426299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 758/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:48.502818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:48.503709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:48.510054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:48.510524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:48.510944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:48.511612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:48.512047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:48.512453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:48.648674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:48.656413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30220fd6-a2de-4de8-94bc-e3866c891018 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.157431 Aug 24 08:03:48.657011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 721/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:49.447369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:49.447969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:49.454459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:49.454933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:49.455361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:49.456142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:49.456589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:49.457027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:49.517218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:49.525099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a397bc87-4fc5-4cc9-bd2a-f82831ff4b7e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081556 Aug 24 08:03:49.525659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 759/1480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:49.679570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:49.680176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:49.686692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:49.687168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:49.687599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:49.688290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:49.688761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:49.689180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:49.817670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:49.825374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2784266e-28a6-4bdb-86c5-6cd07ac36fd7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.149538 Aug 24 08:03:49.825938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 722/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:50.546064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:50.546672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:50.553013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:50.553486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:50.553917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:50.554597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:50.555045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:50.555460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:50.615921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:50.623538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c647617-1c3b-4bfa-a8d1-7a026025b789 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081387 Aug 24 08:03:50.624097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 760/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:50.845864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:50.847207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:50.853692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:50.854161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:50.854585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:50.855257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:50.855697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:50.856107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:50.989134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:50.996813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ee7d34bd-56e1-4ab0-b8d5-a9b63b21dbb1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154746 Aug 24 08:03:50.997381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 723/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:51.644730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:51.645335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:51.651803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:51.652281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:51.652736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:51.653422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:51.653872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:51.654293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:51.717765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:51.725556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-51146df1-f6c4-44fe-84ba-53b5c6be2683 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084793 Aug 24 08:03:51.726119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 761/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:52.017375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:52.017988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:52.024490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:52.025012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:52.025447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:52.026133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:52.026584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:52.027006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:52.042154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:52.157114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:52.165408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d9488d7e-2244-4ef7-ac68-49e964c2e648 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151894 Aug 24 08:03:52.165964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 724/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:52.748473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:52.749920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:52.757647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:52.758123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:52.758557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:52.759240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:52.759713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:52.760131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:52.821158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:52.828920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d2c87566-697b-4cf9-b039-6d51a32c7878 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085132 Aug 24 08:03:52.829483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 762/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:53.186634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:53.187243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:53.194561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:53.195034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:53.195464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:53.196169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:53.196615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:53.197058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:53.325208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:53.333084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9bf0768-97ea-43dd-b06a-0a0c423e9546 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150228 Aug 24 08:03:53.333678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 725/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:53.850648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:53.851261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:53.857812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:53.858295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:53.858738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:53.859430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:53.859892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:53.860317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:53.922495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:53.930684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ba84143e-9969-471e-9386-56a979a893f2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084077 Aug 24 08:03:53.931249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 763/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:53 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:54.353500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:54.354208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:54.360715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:54.361192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:54.361624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:54.362983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:54.363442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:54.363862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:54.495854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:54.503594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-579d817b-8de9-4cbf-8995-40c73dffb204 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154010 Aug 24 08:03:54.504159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 726/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:54.952468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:54.953126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:54.960320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:54.960828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:54.961261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:54.961942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:54.962388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:54.962806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.022723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:55.030443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8f9817f7-a11c-41ca-bafa-1d3c8d3096a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081866 Aug 24 08:03:55.031005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 764/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:55.523595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:55.524196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:55.530761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.531228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.531650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.532325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.532998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.533187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.665322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:55.672905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2407901a-1802-4aeb-aa1c-2f22f0872a1d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153103 Aug 24 08:03:55.673471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 727/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:56.050714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:56.051324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:56.057767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.058247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.058678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:56.059362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.059809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.060229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:56.124595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:56.132350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ddc4f6d-6043-4030-acbd-2526bb9d9080 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085626 Aug 24 08:03:56.132943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 765/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:56.695027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:56.695657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:56.702184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.702650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.703069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:56.703747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.704180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.704587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:56.838974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:56.846827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-256cfa1f-00d3-4cd4-bf22-d40484707283 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155864 Aug 24 08:03:56.847385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 728/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:57.153585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:57.154194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:57.161175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:57.161647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:57.162078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:57.162757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:57.163211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:57.163631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:57.224637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:57.232357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9b669ee-ae4a-48f8-924e-5c7e33c0e044 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082622 Aug 24 08:03:57.232949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 766/1494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:58.000209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:58.000970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:58.007791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.008266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.008721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.009410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.009891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.010311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.142366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:58.150352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b70bfffa-f699-485a-9b5b-6afd5dc3e551 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.286826 Aug 24 08:03:58.153730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 729/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:58.253963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:58.254596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:58.261115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.261593 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.262023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.262706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.263153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.263573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.327060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:58.335571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03dc4e8b-9299-40cf-9b51-f292710ccf2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085794 Aug 24 08:03:58.336131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 767/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:59.170657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:59.171244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:59.173547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=52 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:59.179310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.179780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.180209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.180936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.181383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.181799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.315520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:59.324066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f23baeb9-c6fd-43be-8c9f-131c0bc07903 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.157238 Aug 24 08:03:59.324634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 730/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:59.356848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:59.357455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:59.359717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=56 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:59.364990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.365460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.365885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.366560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.367004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.367419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.428694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:59.435832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1137c665-c1a4-4a12-a6ba-13e69377f66a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082846 Aug 24 08:03:59.436396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 768/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:00.345097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:00.345707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:00.352657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.353159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.353587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.354273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.354722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.355142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.458490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:00.459102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:00.465374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.465845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.466270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.466956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.467399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.467820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.471776 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:00.487950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:00.495877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc3bdb24-2b73-48c4-9837-b8a52b7eb80d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154657 Aug 24 08:04:00.496442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 731/1499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:00.532087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:00.540831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bd104688-c95c-40bd-9243-1e404ff95c48 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086871 Aug 24 08:04:00.541425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 769/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:00 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:01.517123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:01.517675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:01.524092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:01.524566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:01.525026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:01.525706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:01.526157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:01.526573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:01.561771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:01.562378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:01.570015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:01.570492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:01.570924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:01.571617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:01.572064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:01.572480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:01.637701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:01.645527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d85190c6-bbed-4b5c-a883-f8675d986296 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087556 Aug 24 08:04:01.646108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 770/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:01.660798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:01.668544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-64c9ee96-35c5-4acc-83df-2f6c595d5dd8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155387 Aug 24 08:04:01.669131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 732/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:02.669357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:02.669357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:02.672422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:02.672935 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:02.673367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:02.674051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:02.674502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:02.675488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:02.689760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:02.690363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:02.697865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:02.698340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:02.698765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:02.699452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:02.699890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:02.700298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:02.739769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:02.747669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56d02ee6-d4be-476e-8c21-7221a96e4b0c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086093 Aug 24 08:04:02.748250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 771/1503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:02.846533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:02.854346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b86481a9-93fb-4be5-86eb-d44bda85129c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.168592 Aug 24 08:04:02.854908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 733/1504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:03.769664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:03.770425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:03.776878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:03.789917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:03.789917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:03.789917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:03.789917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:03.790347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:03.841078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:03.849082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-413e5e48-d15e-4ac1-acf8-5745faf5eab6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083860 Aug 24 08:04:03.849647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 772/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:03.875114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:03.875713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:03.882938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:03.883404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:03.883827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:03.884504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:03.884979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:03.885388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:04.019610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:04.027450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6502d1ef-96e1-43ad-a0bd-d37ad661198c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156100 Aug 24 08:04:04.028068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 734/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:04.869698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:04.870314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:04.876817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:04.877299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:04.877734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:04.878938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:04.879385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:04.879805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:04.944263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:04.952137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7f64b98d-6c3c-4491-bdcb-592f164779e8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086370 Aug 24 08:04:04.952919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 773/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:05.048049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:05.048663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:05.055923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:05.062757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:05.062757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:05.062757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:05.062757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:05.063142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:05.195473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:05.203190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-89df72d6-4105-40bd-aee9-e036518d8c7f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.158907 Aug 24 08:04:05.203756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 735/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:05.974037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:05.974640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:05.981118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:05.981595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:05.982022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:05.982704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:05.983152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:05.983569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:06.044539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:06.052526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3911fec2-103e-47f5-9351-721f097ff0ed tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083061 Aug 24 08:04:06.053122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 774/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:06.224292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:06.224911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:06.231227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:06.231703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:06.232131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:06.232853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:06.233298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:06.233713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:06.368558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:06.376286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5a23d4ee-9a01-4840-9b80-1732a7589f99 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156150 Aug 24 08:04:06.376893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 736/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:07.073873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:07.074558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:07.081769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.082303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.082721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:07.083418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.083864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.084280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:07.146448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:07.154251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-661586d9-614c-487e-b6a8-d538a416eea2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084273 Aug 24 08:04:07.154823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 775/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:07 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:07.398311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:07.398855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:07.405408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.405888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.406322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:07.407003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.407450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.407979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:07.537579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:07.545238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bb74875c-bce2-4825-96d2-9069b1d2512f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151409 Aug 24 08:04:07.545804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 737/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:08.175746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:08.176487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:08.182744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:08.183244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:08.183669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:08.184354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:08.184830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:08.185249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:08.249892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:08.258318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-401bac48-9e49-4e27-ba4f-f986e71b3792 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086922 Aug 24 08:04:08.258877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 776/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:08.566274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:08.566881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:08.573309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:08.573785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:08.574217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:08.574899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:08.575384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:08.575807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:08.709463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:08.717108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-533a8151-b726-4eab-a97e-d9d8646522de tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154886 Aug 24 08:04:08.717680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 738/1514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:09.408460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:09.409100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:09.415013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:09.415501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:09.415933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:09.416694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:09.417130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:09.417557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:09.481486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:09.489141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3ee82efb-4eaf-4320-a336-7a4fbe05c3b7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.211507 Aug 24 08:04:09.489697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 777/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:09.738424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:09.739027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:09.745492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:09.745970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:09.746399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:09.747076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:09.747520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:09.747937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:09.878811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:09.886396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-86001dc8-b44f-42f3-91c7-060eb5769807 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151812 Aug 24 08:04:09.886956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 739/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:10.509650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:10.510289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:10.516666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:10.517149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:10.517581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:10.518282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:10.519354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:10.519799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:10.580283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:10.588811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-31dc48c9-f922-4881-a2df-c1f0a8e763e7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082932 Aug 24 08:04:10.589361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 778/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:10.908019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:10.908685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:10.915655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:10.916127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:10.916556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:10.917260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:10.917704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:10.918118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:11.057349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:11.065028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d2b8e84-9d4f-44c9-ae0e-9d65e04cdba0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.160836 Aug 24 08:04:11.065860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 740/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:11.610111 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:11.610731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:11.617154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:11.617631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:11.618068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:11.618755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:11.619204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:11.619626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:11.680380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:11.688041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ed7d2412-0367-45f4-beff-bcc956bf58a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081877 Aug 24 08:04:11.688596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 779/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:12.086015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:12.086622 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:12.092617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:12.093123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:12.093554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:12.094232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:12.094677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:12.095090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:12.097639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:12.224166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:12.231903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-43244f86-bbfe-401d-8ff2-cafa6d04eb65 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150521 Aug 24 08:04:12.232475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 741/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:12.710510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:12.711146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:12.717666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:12.718140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:12.718570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:12.719355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:12.719806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:12.720225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:12.782978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:12.792088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa5729c5-0d18-47c6-9027-e29d7b363524 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086259 Aug 24 08:04:12.792676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 780/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:13.251895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:13.252503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:13.259935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:13.260415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:13.260876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:13.261556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:13.262000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:13.262412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:13.397931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:13.405558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0933a3d9-abf6-4118-9b4a-b07a586d89fb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.157573 Aug 24 08:04:13.406120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 742/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:13.812536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:13.813173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:13.819847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:13.820325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:13.820786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:13.821499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:13.821946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:13.822365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:13.885295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:13.892978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c90cc51c-d1d9-427d-bbf7-4fc659cd11be tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084345 Aug 24 08:04:13.893645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 781/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:13 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:14.425341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:14.425946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:14.432322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:14.432833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:14.433268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:14.433944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:14.434396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:14.434812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:14.564169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:14.572882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-48a47c75-e739-4fb1-bdeb-095aada8ae68 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151367 Aug 24 08:04:14.573455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 743/1524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:14.914023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:14.914561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:14.921030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:14.921503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:14.921932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:14.922616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:14.923062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:14.923477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:14.984665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:14.992916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-879c9e60-9172-490b-b263-b37897ba7718 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082791 Aug 24 08:04:14.993482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 782/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:15.594372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:15.594978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:15.602319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:15.602800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:15.603231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:15.603917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:15.604361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:15.604805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:15.736949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:15.744694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76a1d53c-2cd4-4339-8d90-27292d5b25b8 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154157 Aug 24 08:04:15.745276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 744/1526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:16.014062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:16.014669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:16.021397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.021868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.022297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.022997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.023450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.023868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.086502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:16.094143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d3a3f3f-240f-46d6-b92a-0363cf7c73b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083935 Aug 24 08:04:16.094705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 783/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:16.765249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:16.765861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:16.772891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.773369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.773800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.774490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.774940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.775360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.904659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:16.912561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-98a2fc40-f36c-4784-a7df-01652c8251b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151293 Aug 24 08:04:16.913160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 745/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:17.115685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:17.116348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:17.122652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.123115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.123540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:17.124206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.124724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.125081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:17.190233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:17.198409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c937fbff-f738-454b-aae7-fee6a42ad479 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087007 Aug 24 08:04:17.199091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 784/1529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:17.933630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:17.934232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:17.942075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.942550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.942981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:17.943660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.944097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.944509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:18.076343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:18.084590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec1ecb1e-156d-4025-ab7a-66689e43560d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154825 Aug 24 08:04:18.085191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 746/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:18.219878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:18.220406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:18.227710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:18.228189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:18.228623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:18.229325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:18.229768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:18.230182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:18.296260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:18.300415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:18.305200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b3e8dc8-511b-452e-a071-330418aad9ff tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.089582 Aug 24 08:04:18.305764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 785/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:19.105687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.106319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.113141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.113608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.114032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.114699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.115137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.115547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.255508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:19.260708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-90ae7131-dc32-4236-ba86-d25a2a96b828 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.158779 Aug 24 08:04:19.261280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 747/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:19 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:19.325620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.326240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.333663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.334155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.334596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.335292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.335746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.336169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.397591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:19.405742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b0790edd-09b2-4a8e-af04-db766ab94125 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083956 Aug 24 08:04:19.406320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 786/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:19 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:19.558578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.559074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.566048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.566538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.567016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.567889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.568395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.569370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.569832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.570258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.585977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.590851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.591608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.592713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.593360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.593795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.610399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Going to try to terminate instance {{(pid=132893) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:04:19.888214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-db6999e1-73c4-4723-bdd0-0f5ac5e1216c tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 204 len: 0 microversion: 2.1 time: 0.333139 Aug 24 08:04:19.888838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 748/1534] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:04:19 2022] DELETE /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:04:19.897826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.902162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.904363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.905446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.905446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.905987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.906433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.906856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.036056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:20.044330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8f19a8cc-a0dc-43f4-ba3c-6b3cd54093a9 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1675 microversion: 2.1 time: 0.151104 Aug 24 08:04:20.044947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 749/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:19 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:20.281533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:20.282192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:20.289012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.289481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.289903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.290569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.291007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.291419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.487640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:20.496056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72c43de2-1454-4335-b618-536c20d83b0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.218430 Aug 24 08:04:20.496619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 750/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:20.501014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:20.501606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:20.507750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.508146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.508566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.509264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.509702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.510120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.590305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:20.598827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25987091-d785-4605-98fa-b789b59ef1f7 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.101186 Aug 24 08:04:20.599599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 751/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:21.069807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:21.069807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:21.074392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.074936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.075433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.076193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.076737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.077223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.155082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:21.163150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f10bb0a0-3714-4b9c-8445-2cc8c56db7e5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1607 microversion: 2.1 time: 0.100691 Aug 24 08:04:21.163729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 752/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:21 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:21.345744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d25948-e2ff-41c2-81d7-c9912a94ec45", "name": "network-vif-deleted", "tag": "f4fc24f2-6d76-46cc-916f-e5583fdcf10a"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:04:21.356323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.356833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.357253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.369888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] Creating event network-vif-deleted:f4fc24f2-6d76-46cc-916f-e5583fdcf10a for instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 on hv-cinder-85427 Aug 24 08:04:21.374919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-c4ba4395-a4b4-40f7-a3bc-a72c3dd01ab3 req-1bd5496e-3379-4885-a303-d7bb102fd816 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Aug 24 08:04:21.375719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 753/1539] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:04:21.521593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:21.522421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:21.531917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.531917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.531917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.531917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.532350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.532350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.678974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:21.688335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e45a256b-995d-4d0c-94f0-02f36f388fbf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.174236 Aug 24 08:04:21.690703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 754/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:21.703336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:21.703984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:21.719565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.720064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.720686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.721411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:21.721850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:21.722256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.789931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:21.798233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9e11368d-f715-4134-af54-e1e8f90f120f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.107930 Aug 24 08:04:21.798809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 755/1541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:22.184512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:22.185199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:22.192299 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.192978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.193411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.194106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.194619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.195038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.232923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.233399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.233832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.234273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lazy-loading 'fault' on Instance uuid 72d25948-e2ff-41c2-81d7-c9912a94ec45 {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:04:22.236157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:22.283446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec3daa674814619976aead75459e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7043fd37a1040c2af5d3f9f2943a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:22.291661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2cb256e2-6907-4ca4-b08a-a52c161c5097 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 200 len: 1328 microversion: 2.1 time: 0.111069 Aug 24 08:04:22.292233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 756/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:22 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:22.710323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:22.710985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:22.717667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.723197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.723197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.723197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.723197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.723585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.853129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:22.861081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3cb24d1c-bf2a-4ea0-b30a-43d6424a3dd0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155028 Aug 24 08:04:22.861676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 757/1543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:22.867169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:22.870013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:22.873322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.873789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.874211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.874882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.875323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.875734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.937317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:22.945658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-851888bf-1487-4c6e-8338-e7e2b4140025 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083022 Aug 24 08:04:22.946225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 758/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:23.313113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:23.313712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:23.320575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:23.321117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:23.321541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:23.322218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:23.322663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:23.323087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:23.337053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 HTTP/1.1 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:04:23.338729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:04:23.340336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '72d25948-e2ff-41c2-81d7-c9912a94ec45'} Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:04:23.342106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:04:23.343637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:04:23.345038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:04:23.345038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4f36717a-1c28-4d8f-808f-d24cc49de293 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 404 len: 111 microversion: 2.1 time: 0.030914 Aug 24 08:04:23.345038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 759/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:23 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:04:23.348615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f2b47c6a-f814-4eb3-bf42-1006cc558cb3 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '.version_select at 0x7f456b659ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:23.353021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2b47c6a-f814-4eb3-bf42-1006cc558cb3 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:04:24.361339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2b47c6a-f814-4eb3-bf42-1006cc558cb3 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57236. Aug 24 08:04:24.436812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f2b47c6a-f814-4eb3-bf42-1006cc558cb3 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655937466" status: 202 len: 0 microversion: 2.1 time: 1.091792 Aug 24 08:04:24.437400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 760/1546] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Aug 24 08:04:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655937466 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:04:24.444409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:24.444409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:24.451039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.451693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.452086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.452790 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.453236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.453645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.593618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:24.602435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e70f1566-75d9-4944-aa4e-371e42f54ee1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.164057 Aug 24 08:04:24.603003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 761/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:24.607516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:24.608112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:24.614170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.614585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.615011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.615692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.616149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.616553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.678162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:24.686355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d6fbd5d7-9582-4c31-8817-f42934f0fd8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082373 Aug 24 08:04:24.686923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 762/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:24 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:25.623348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:25.623957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:25.630589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.631062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.631492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.632170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.632618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.633092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.763164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:25.771120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-181748b8-c3d1-40a7-9165-eaa26a426e4d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151609 Aug 24 08:04:25.771779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 763/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:25.776176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:25.776938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:25.782490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.785581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.785581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.785581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.785581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.785980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.849358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:25.856887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-29930d54-a5ad-4078-a082-1b3c5496d5a1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084140 Aug 24 08:04:25.857445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 764/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:25 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:26.791908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:26.792558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:26.798940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.799413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.799877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.801104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.801556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.802001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.933640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:26.943308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bf48cdfc-adce-4dda-bb11-dab059cb3a0b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155291 Aug 24 08:04:26.943880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 765/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:26.948592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:26.949504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:26.955168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.955636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.956067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.956771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.957373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.957791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:27.017962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:27.025795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5ebad752-c3ec-4e4c-a6fb-41729e1fbaa6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080978 Aug 24 08:04:27.026364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 766/1552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:26 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:27.963993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:27.964599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:27.970997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:27.971467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:27.971894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:27.972574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:27.973046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:27.973462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:28.109291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:28.117106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0264461b-99e7-467f-a3cd-11d9eb6d25b0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156884 Aug 24 08:04:28.117674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 767/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:28.121988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:28.122578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:28.128021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:28.129141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:28.129444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:28.130468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:28.130599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:28.131007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:28.193459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:28.201041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f8f0e03-242d-49d8-82d9-948b31b23144 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082393 Aug 24 08:04:28.201611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 768/1554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:28 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:29.138164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:29.138946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:29.146094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.146560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.146989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.147659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.148096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.148546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.277775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:29.286078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-951eca49-0557-4e7f-8073-273df835f91b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151993 Aug 24 08:04:29.286637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 769/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:29 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:29.290938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:29.291564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:29.293150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:29.297654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.298127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.298553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.299234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.299678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.300093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.364312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:29.372668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3397cd1e-7281-47a8-8140-4dbc1936e71d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085074 Aug 24 08:04:29.373244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 770/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:29 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:29.583247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=39 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:29.615100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=10 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:30.307840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:30.308444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:30.315664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:30.316217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:30.316800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:30.317484 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:30.317925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:30.318334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:30.447060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:30.454722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8b1f080f-2ed6-4674-b632-fc8db833047b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151087 Aug 24 08:04:30.455309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 771/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:30.460680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:30.461277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:30.466824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:30.467300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:30.467718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:30.468385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:30.468853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:30.469265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:30.529313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:30.538030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b26fbe1d-0982-4dde-8bb2-92ea154de79c tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081745 Aug 24 08:04:30.538637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 772/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:30 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:31.475762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:31.476422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:31.482784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:31.483255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:31.483678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:31.484349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:31.484850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:31.485258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:31.621286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:31.628926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2ce597b0-4ca7-4610-9c4a-f249498c8134 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.157419 Aug 24 08:04:31.629603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 773/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:31.633975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:31.634575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:31.640177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:31.640675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:31.641122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:31.641808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:31.642255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:31.642672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:31.703074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:31.705175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:31.711131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eeae98cb-81fc-4c9c-a44c-85ef1b3646e2 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080586 Aug 24 08:04:31.711707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 774/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:31 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:32.650620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:32.651253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:32.658054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:32.658481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:32.658910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:32.659591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:32.660041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:32.660460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:32.792155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:32.799946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4bce8980-061a-4581-ad35-6a539ce1257e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154584 Aug 24 08:04:32.800509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 775/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:32.805052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:32.805716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:32.811178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:32.811647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:32.812117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:32.812852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:32.813295 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:32.813705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:32.878491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:32.886294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3ba4ac84-e1bb-42ac-b2a1-2d8d38a11083 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084830 Aug 24 08:04:32.886866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 776/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:32 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:33.820895 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:33.823952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:33.827890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:33.828366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:33.828859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:33.829536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:33.829976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:33.830390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:33.961341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:33.968968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-281175fe-83fb-4dd8-8e08-4f9d33fadcf4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152094 Aug 24 08:04:33.969533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 777/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:33.974369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:33.974966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:33.980428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:33.980920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:33.981349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:33.982028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:33.982471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:33.982941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:34.044781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:34.053335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b3af3a54-8dde-4658-a75d-463cd1c4a1e1 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082871 Aug 24 08:04:34.053892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 778/1564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:33 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:34.990780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:34.991449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:34.997862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:35.005752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:35.005752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:35.005752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:35.005752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:35.006133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:35.134725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:35.142664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7ccce35c-3f10-47e1-9a4b-db47e8373729 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156340 Aug 24 08:04:35.143234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 779/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:35.147835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:35.148442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:35.154111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:35.154825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:35.155260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:35.155948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:35.156394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:35.156846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:35.218407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:35.226237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a63b2f8f-050d-4f40-9e1b-ddb164574bcb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081872 Aug 24 08:04:35.226803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 780/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:35 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:36.162915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:36.163614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:36.170028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:36.170513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:36.170946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:36.171666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:36.172114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:36.172532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:36.301244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:36.309082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-079e621c-540a-4cf5-90b8-ebc6332971b1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150033 Aug 24 08:04:36.309678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 781/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:36.314002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:36.314602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:36.320910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:36.321429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:36.321865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:36.322547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:36.322996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:36.323416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:36.387266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:36.394964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d301db7f-ed71-489c-828e-459ea283f436 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084352 Aug 24 08:04:36.395540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 782/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:36 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:37.330624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:37.331343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:37.337917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:37.338380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:37.338815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:37.339470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:37.339909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:37.340318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:37.473762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:37.479489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-43fa046d-f766-4d0f-be3d-3199cae3aeb4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152686 Aug 24 08:04:37.480078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 783/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:37 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:37.484383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:37.485005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:37.491243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:37.491762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:37.492197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:37.492905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:37.493351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:37.493765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:37.555177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:37.562879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-82e3fc52-70ca-47f0-93c2-eaf84f5869b9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081871 Aug 24 08:04:37.563440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 784/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:37 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:38.501370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:38.502018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:38.508900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:38.509369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:38.509791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:38.510460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:38.510900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:38.511307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:38.643569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:38.651609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fdeb1f24-0b87-410d-9ae0-d1be96b12bb5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154176 Aug 24 08:04:38.652172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 785/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:38.656677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:38.657254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:38.662928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:38.663395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:38.663824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:38.664498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:38.664979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:38.665397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:38.725793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:38.733364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-16dd6f21-d4fe-4a30-8b23-02621b794a39 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080234 Aug 24 08:04:38.733933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 786/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:38 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:39.672230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:39.672860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:39.679647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:39.680130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:39.680560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:39.681277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:39.681725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:39.682142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:39.811318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:39.819646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c505c32-c6d2-4336-9821-550b4644634a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150829 Aug 24 08:04:39.820252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 787/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:39.824578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:39.825204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:39.830635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:39.831104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:39.831532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:39.832206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:39.832670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:39.833091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:39.895748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:39.904021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-967c34be-4fde-4bbf-a142-b4f73468d651 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082793 Aug 24 08:04:39.904588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 788/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:39 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:40.841284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:40.841966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:40.848329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:40.848835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:40.849270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:40.849944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:40.850495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:40.851404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:40.979372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:40.986986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c02b5985-aa36-4ce4-8022-3af99c31d9a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.149519 Aug 24 08:04:40.987556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 789/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:40.992011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:40.992620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:40.998244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:40.998709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:40.999133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:40.999810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:41.000252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:41.000686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:41.062374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:41.070631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0a0f5a5c-0dd5-4995-afaf-3efb44e46d0f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082141 Aug 24 08:04:41.071199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 790/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:40 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:42.007784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:42.008412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:42.014694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:42.015319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:42.015751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:42.016424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:42.016889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:42.017305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:42.032619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:42.151881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:42.159538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f777d14b-41c2-4697-9795-9d958f8f7f53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156138 Aug 24 08:04:42.160099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 791/1577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:42.165986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:42.166643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:42.172352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:42.172868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:42.173301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:42.174007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:42.174469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:42.174888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:42.235383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:42.243804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-086207b7-dce3-4862-8660-8f394034ae2d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082769 Aug 24 08:04:42.244365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 792/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:42 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:43.181294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:43.181971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:43.188318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:43.188831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:43.189268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:43.190739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:43.191196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:43.191620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:43.320859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:43.328577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4bb1c00e-3190-4b14-b8e8-c7cbe926734c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151778 Aug 24 08:04:43.329167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 793/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:43.333528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:43.334134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:43.339778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:43.340359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:43.340917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:43.341654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:43.342102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:43.342511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:43.407320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:43.415281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f7dd9b71-97d6-4efa-a04d-59557b7ddbd3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085180 Aug 24 08:04:43.415846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 794/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:43 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:44.348715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:44.349380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:44.356032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:44.356496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:44.356958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:44.357623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:44.358067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:44.358475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:44.733381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:44.741159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dcab2136-30c1-48e8-98f7-010b28fa869c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.396150 Aug 24 08:04:44.741726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 795/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:44.746046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:44.746637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:44.752070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:44.752541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:44.753000 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:44.753677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:44.754152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:44.754570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:44.814595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:44.822476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7afc9161-b94b-4ba4-9cfb-7dbd6b1db5de tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.079818 Aug 24 08:04:44.823035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 796/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:44 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:45.762751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:45.763375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:45.769748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:45.770222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:45.770651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:45.771330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:45.771783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:45.772232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:45.903113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:45.910729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9affbc20-1cb0-4996-a16c-a2556789f8fe tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151822 Aug 24 08:04:45.911297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 797/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:45.916330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:45.916945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:45.922467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:45.922938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:45.923365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:45.924045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:45.924493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:45.924931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:45.985225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:45.993471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-852ce26f-2421-4eb6-8690-0a1c94b7ebf4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081245 Aug 24 08:04:45.994034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 798/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:45 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:46.932219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:46.932913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:46.939300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:46.939779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:46.940462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:46.941206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:46.941654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:46.942073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:47.070176 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:47.077928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3d109975-45bc-42ce-b99c-dcb47c8cd99d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150099 Aug 24 08:04:47.078498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 799/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:47.082841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:47.083446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:47.089077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:47.089552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:47.090002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:47.090718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:47.091161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:47.091580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:47.154660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:47.162418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-790710a7-24d9-40d8-93c1-1de8d0fab3a0 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082978 Aug 24 08:04:47.163059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 800/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:47 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:48.098889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:48.099565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:48.106043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:48.106517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:48.106943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:48.107621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:48.108065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:48.108483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:48.239388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:48.250416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-37407a27-03de-4f7c-96c0-e3b5dd0a3f39 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155371 Aug 24 08:04:48.250986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 801/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:48 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:48.255499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:48.256096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:48.262966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:48.263447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:48.263881 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:48.264569 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:48.265046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:48.265463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:48.330912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:48.338819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bccd5942-ef4b-4e82-a85e-9d459308037f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086901 Aug 24 08:04:48.339379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 802/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:48 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:49.272130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:49.272799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:49.279959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:49.280440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:49.280893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:49.281586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:49.282032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:49.282447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:49.414483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:49.422835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5f38e732-6e65-4687-8190-5e24a3447c5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154537 Aug 24 08:04:49.423411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 803/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:49.427714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:49.428312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:49.434398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:49.434869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:49.435298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:49.435976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:49.436422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:49.436867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:49.497533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:49.505048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0f7c0b0a-bf24-4e70-9729-c086d9a4624f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080679 Aug 24 08:04:49.505722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 804/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:49 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:50.444089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:50.444794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:50.451866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:50.452333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:50.452794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:50.453472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:50.453908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:50.454344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:50.583829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:50.592164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-913fa93d-9a37-4616-94fc-5af3d0023e25 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152120 Aug 24 08:04:50.592753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 805/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:50.597170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:50.597765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:50.604352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:50.604864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:50.605288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:50.605963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:50.606403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:50.606815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:50.670405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:50.678010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8c2d3727-3b44-4f6e-b128-c45188c48962 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084331 Aug 24 08:04:50.678572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 806/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:50 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:51.613460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:51.614114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:51.621413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:51.621877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:51.622298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:51.622974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:51.623412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:51.623823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:51.753949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:51.761682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-961b709a-f445-4d14-9dd2-eaa0e4e154a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152046 Aug 24 08:04:51.762246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 807/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:51.766617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:51.767206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:51.772558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:51.773133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:51.773588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:51.774272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:51.774783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:51.775191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:51.779083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:51.835997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:51.843823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e04edbc6-663d-4281-821d-9f7f1c01c79a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080649 Aug 24 08:04:51.844387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 808/1594] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:51 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:52.782458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:52.783157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:52.789626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:52.790166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:52.790769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:52.791454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:52.791903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:52.792323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:52.924426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:52.932945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5c4af4f6-0f47-46c2-a2b8-f802ddce83c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154330 Aug 24 08:04:52.933510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 809/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:52.937777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:52.938366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:52.944105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:52.944572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:52.945023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:52.945691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:52.946862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:52.947533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:53.006736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:53.015199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49b9d75c-df57-43db-b41d-c925dbf4a4bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080768 Aug 24 08:04:53.015767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 810/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:52 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:53.955074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:53.955682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:53.962483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:53.962946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:53.963375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:53.964047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:53.964485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:53.964933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:54.094128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:54.101932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-06c75d7f-7f39-44fe-bc3e-feb863e598b5 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150670 Aug 24 08:04:54.103194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 811/1597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:54.107637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:54.108236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:54.114118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:54.114590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:54.115022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:54.115700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:54.116150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:54.116572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:54.182373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:54.190297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2577d154-9aa1-4f6a-bcc4-abfeefeef429 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085808 Aug 24 08:04:54.190865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 812/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:54 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:55.123708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:55.124384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:55.130655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:55.131122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:55.131540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:55.132206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:55.132665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:55.133078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:55.263821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:55.271532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-79a68e33-0006-4b7e-9ae4-88f1ac54a933 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151591 Aug 24 08:04:55.272073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 813/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:55.276957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:55.277553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:55.283170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:55.283643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:55.284073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:55.284778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:55.285283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:55.285701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:55.346683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:55.354906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1691a4e3-3ba3-4c27-8fe3-de17c7e9ae02 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081898 Aug 24 08:04:55.355468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 814/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:55 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:56.293205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:56.293918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:56.300161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:56.300631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:56.301076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:56.301747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:56.302190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:56.302602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:56.435440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:56.443900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7eb73a40-f54a-4ab2-8dcb-34fbbccad92b tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155114 Aug 24 08:04:56.444473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 815/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:56.449708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:56.450305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:56.455942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:56.456414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:56.456876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:56.457555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:56.458031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:56.458450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:56.519731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:56.527718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a13cd975-47c3-4fed-8acf-6a4de5dd4404 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082169 Aug 24 08:04:56.528277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 816/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:56 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:57.465282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:57.465955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:57.472329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:57.472841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:57.473277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:57.473958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:57.474406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:57.474825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:57.605812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:57.613415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1f13c69d-fa07-4070-afef-adb4f3671ef3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152158 Aug 24 08:04:57.613967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 817/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:57.618906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:57.619501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:57.625086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:57.625859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:57.626291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:57.626966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:57.627410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:57.627824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:57.693831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:57.701774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f10ff7a4-decf-453a-9800-36709fc89056 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.086878 Aug 24 08:04:57.702338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 818/1604] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:57 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:58.634372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:58.634989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:58.641368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:58.641837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:58.642261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:58.642932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:58.643371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:58.643792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:58.773258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:58.781775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ce183f8a-580c-48d8-a58d-455e0568714a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151464 Aug 24 08:04:58.782337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 819/1605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:58 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:58.786683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:58.787209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:58.788788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:58.793488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:58.793958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:58.794383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:58.795083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:58.795525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:58.795936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:58.857059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:58.864545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d42fc2e5-66b8-4086-8c77-f47f8a9d846f tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081285 Aug 24 08:04:58.865136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 820/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:58 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:59.801902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:59.802555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:59.809145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:59.809616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:59.810043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:59.810719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:59.811164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:59.811579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:59.944135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:59.952545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-71609f2a-dcec-4b7d-8cb6-193870b4901c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154565 Aug 24 08:04:59.953137 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 821/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:04:59.957423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:59.958018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:59.963469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:59.963935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:59.964358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:59.965067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:59.965509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:59.965926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:00.026982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:00.034641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0b6fcbf0-f556-470b-9ebf-d0ea4515c5a9 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080575 Aug 24 08:05:00.041794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 822/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:59 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:00.973310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:00.973980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:00.981061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:00.981536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:00.981964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:00.982650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:00.983094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:00.983506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:01.113018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:01.121417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-276c0718-724a-42dd-810e-f0c5e3b2e1c1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152007 Aug 24 08:05:01.121982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 823/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:01.126249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:01.126835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:01.132222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:01.132719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:01.133144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:01.133811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:01.134304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:01.134779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:01.198950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:01.201113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:01.207343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4cec36da-1129-4560-b23d-d1796e270b0a tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084395 Aug 24 08:05:01.211155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 824/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:01 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:02.142222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:02.142910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:02.150339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:02.150812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:02.151237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:02.151916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:02.152359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:02.152803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:02.283207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:02.291076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4cd23309-cf05-45af-941e-bd9de229d9aa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.152702 Aug 24 08:05:02.291636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 825/1611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:02.295902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:02.296496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:02.302316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:02.302786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:02.303209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:02.303882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:02.304322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:02.304766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:02.368047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:02.377013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-93d98ac8-73f0-4ffb-b21e-0816a0a7c08e tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084410 Aug 24 08:05:02.377582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 826/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:02 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:03.311745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:03.312471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:03.319081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.319546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.319965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.320636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.321138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.321994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.455788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:03.463701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-16cc715b-d12e-4160-aa9d-1e057143e769 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155832 Aug 24 08:05:03.464269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 827/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:03.468555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:03.469181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:03.474752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.475222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.475648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.476320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.476805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.477222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.537158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:03.545422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-95979fa4-5aa6-4610-927d-f6c37c359511 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080191 Aug 24 08:05:03.545982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 828/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:03 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:04.484636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:04.485334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:04.491643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.492112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.492542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.493244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.494223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.494637 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.624818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:04.632498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-91a508b4-0862-4d8a-9fbd-259bebe1d680 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151754 Aug 24 08:05:04.633095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 829/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:04.637502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:04.638111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:04.643577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.644056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.644510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.645257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.645706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.646125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.709969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:04.718336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8c7d7769-23bd-4397-b1d7-7d35acb5ea16 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.084303 Aug 24 08:05:04.718907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 830/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:04 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:05.653820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:05.654455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:05.660905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.661367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.661786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:05.662453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.662890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.663298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:05.792312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:05.799991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72ef1a97-b29b-4d15-9ab2-3020f49f1ff6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150844 Aug 24 08:05:05.800556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 831/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:05.804841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:05.805428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:05.811524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.811996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.812418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:05.813204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.813643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.814056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:05.874212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:05.881839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4e0bff76-e326-4818-9408-f25df784bf8b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080347 Aug 24 08:05:05.882406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 832/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:05 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:06.821668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:06.822347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:06.829166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:06.830493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:06.830493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:06.830736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:06.831184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:06.831600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:06.976958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:06.985548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1cfd7977-e66f-4abd-87c7-b65f266fb3f0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.167695 Aug 24 08:05:06.986122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 833/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:06.994271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:06.994970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:07.000837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:07.001304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:07.001974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:07.003153 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:07.003605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:07.004018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:07.067401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:07.075183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dc4b1097-906d-4756-acfe-0bd7d3841317 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.087318 Aug 24 08:05:07.075677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 834/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:06 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:08.006765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:08.007447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:08.014514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.014994 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.015421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.016105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.016549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.016999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.149814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:08.157665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3f9298d3-520c-4656-9ec2-23e1247989fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.154739 Aug 24 08:05:08.158236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 835/1621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:08 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:08.162585 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:08.163188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:08.169595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.170078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.170515 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.171222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.171677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.172118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.240864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:08.249333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-50b36205-bbcb-475d-a268-ed33fe8e6abf tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.090150 Aug 24 08:05:08.249901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 836/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:08 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:09.178820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:09.179506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:09.186092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.186595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.187017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.187688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.188129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.188539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.319675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:09.328113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9cfd906-da61-4de4-a597-99db188b56d0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153148 Aug 24 08:05:09.328698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 837/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:09.333031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:09.333623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:09.339806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.340271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.340709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.341411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.341849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.342258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.402450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:09.409990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e48a44f3-02fa-445d-aae2-355976e6ac65 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080367 Aug 24 08:05:09.410657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 838/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:09 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:10.349944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:10.350648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:10.357658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.358125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.358553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.359229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.359675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.360087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.492116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:10.499903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0997621f-0135-4e73-a461-92dded0919b4 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153841 Aug 24 08:05:10.500475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 839/1625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:10.504847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:10.505441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:10.511472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.511945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.512397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.513125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.513562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.514003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.575846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:10.583435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d59c6b10-adc1-4393-ba6b-2c27beb9deea tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.082010 Aug 24 08:05:10.583997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 840/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:10 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:11.520567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:11.521273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:11.528320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.528825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.529253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.529933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.530368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.530783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.545995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=100 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:11.662255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:11.670072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0c984cdf-1f25-469c-a75d-85d3695cd0e2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153309 Aug 24 08:05:11.670640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 841/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:11.675117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:11.675717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:11.681280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.681941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.682405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.683048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.683496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.683921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.747711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:11.755364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a3bfe97c-7ea7-4237-a9c5-356cd030e9a6 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083796 Aug 24 08:05:11.755923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 842/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:11 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:12.691595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:12.692343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:12.698974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:12.699443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:12.699865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:12.700540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:12.701003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:12.701413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:12.830901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:12.839061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-233baa77-4ebf-4341-8213-e11d08e82305 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.151676 Aug 24 08:05:12.839615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 843/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:12.844249 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:12.844870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:12.850311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:12.850778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:12.851198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:12.851867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:12.852305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:12.852744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:12.912485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:12.920700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b2405143-7c1b-4c33-8d18-ea0fc438916d tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.080064 Aug 24 08:05:12.921260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 844/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:12 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:13.860244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:13.861016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:13.867488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:13.867970 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:13.868451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:13.869914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:13.870361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:13.870778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.002859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:14.011653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-df075c82-097c-41ef-bb34-0b7ee3a66ace tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.155138 Aug 24 08:05:14.012500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 845/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:14.017485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:14.018082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:14.026117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.026910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.027345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.028032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.028475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.028922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.111473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:14.119638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2a781470-251c-4e8e-adb7-50614eaa69c8 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.105716 Aug 24 08:05:14.120485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 846/1632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:14 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:15.034093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:15.034673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:15.041263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.041732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.042149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.042845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.043287 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.043694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.172694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:15.180512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fd3b0af3-8b38-4bae-b74b-c2e24b213fa0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.150182 Aug 24 08:05:15.181101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 847/1633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:15.186356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:15.186942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:15.192794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.193261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.193691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.194361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.194799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.195209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.260613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:15.268306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f175633a-0273-4c2e-9767-77808477fb38 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.085606 Aug 24 08:05:15.269080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 848/1634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:15 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:16.202269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:16.202905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:16.209338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:16.209805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:16.210224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:16.210893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:16.211331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:16.211741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:16.340086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:16.347999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30eb75e3-007d-4afe-ad57-4b19c1a361c0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.149326 Aug 24 08:05:16.348565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 849/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:16.352819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:16.353910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:16.359438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:16.359905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:16.360330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:16.361030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:16.361466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:16.361876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:16.423007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:16.430583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-75ed14f2-e7cb-4d96-86fb-89465ab2cf4b tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081074 Aug 24 08:05:16.431170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 850/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:16 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:17.369258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:17.369914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:17.377041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:17.377516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:17.377937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:17.378612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:17.379082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:17.379491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:17.513843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:17.521744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0b5dfdf0-5e7c-44dc-840f-3b305e89f952 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.156319 Aug 24 08:05:17.522310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 851/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:17 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:17.526992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:17.527600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:17.533470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:17.533971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:17.534402 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:17.535093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:17.535596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:17.536016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:17.597091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:17.605276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cd140958-ce37-4e04-a019-2cb2c59ef973 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.081339 Aug 24 08:05:17.606091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 852/1638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:17 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:18.543429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:18.544068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:18.550857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:18.551330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:18.551784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:18.552458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:18.552930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:18.553370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:18.684788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:18.692770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-11a3a546-e70d-48ba-979a-e0d3110bc953 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.153775 Aug 24 08:05:18.693351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 853/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:18 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:18.697608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:18.698341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:18.703856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:18.704345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:18.704814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:18.705492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:18.705937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:18.706355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:18.769636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:18.777874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-147df553-2478-4a00-830d-90119cc498ef tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1225 microversion: 2.1 time: 0.083592 Aug 24 08:05:18.783319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 854/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:18 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:19.619563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:19.620238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:19.626889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:19.627390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:19.627842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:19.628526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:19.629020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:19.629437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:28.403608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:05:28.404177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 (ip 10.222.0.26) !!! Aug 24 08:05:29.624657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=71 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:29.648423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=85 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:40.827482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:05:40.828079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 (ip 10.222.0.26) !!! Aug 24 08:06:19.688904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 810c41f4-f7ab-43b6-bbdb-81d52de49f0d {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:06:19.772143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 810c41f4-f7ab-43b6-bbdb-81d52de49f0d {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:06:29.701425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:29.777922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=4 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:03.133987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:07:03.135245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 (ip 10.222.0.26) !!! Aug 24 08:07:12.977046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:07:12.977660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 (ip 10.222.0.26) !!! Aug 24 08:07:23.196236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:07:23.196864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 (ip 10.222.0.26) !!! Aug 24 08:08:20.159420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Request method failure captured: Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 HTTP/1.1 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdl1Qn076i86puRCzMLA3WTs3HXoAiWMhPnNkO458eXmJQXX7F1JYuB2H93kTtMjeP3CnoDjcg3CEwUpx5WnLBcuIs7An_vDtJYUKjhT2j0Z5Oeo1xJHC6tkZDD7aCR5qD2v5JO6eLiwqR__ITswAZEGMSAvgVCida8AGo4JNASY8ng Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:08:20.161941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}] Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: ab1a288170374d1a80355c869c78b4ca Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:20.163411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '810c41f4-f7ab-43b6-bbdb-81d52de49f0d', 'id': '75f8d53c-d72e-4a92-a270-4910c26a39c2'} Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:20.164253 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:20.165484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.166678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.169847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) Aug 24 08:08:20.171969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.174600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d976e70-5ca4-4aea-b7ee-abd5f5b20a47) {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:20.174600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c3953ac3-8957-4609-9a90-ad7bd067a0b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2" status: 400 len: 269 microversion: 2.1 time: 240.601021 Aug 24 08:08:20.174600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 787/1641] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:04:19 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 => generated 269 bytes in 240602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:08:20.174600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.174970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.194454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.196917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.196917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.197565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.198552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.199190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.259980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f22ceda8-dbbe-429d-8b17-f12275a8b20b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2" status: 202 len: 0 microversion: 2.1 time: 180.644143 Aug 24 08:08:20.261185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 855/1642] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:05:19 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 => generated 0 bytes in 180646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:08:20.281080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.282960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.297852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.298354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.299007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.300340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.301575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.302180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.363407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:20.371645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c4fe222-1812-41f6-ba4e-45ae75e5c6d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1450 microversion: 2.1 time: 0.206656 Aug 24 08:08:20.372471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 788/1643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1450 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:20.375779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.376261 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.376901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.377353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lazy-loading 'fault' on Instance uuid 996f4b36-7aa5-49d2-b619-ef9af95054de {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:20.381462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.382618 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.415255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.415255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.415255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.415255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.416155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.416155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.480327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:20.500438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d443c792-e51a-48bf-9cc0-2d470c9fc2bb tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1230 microversion: 2.1 time: 0.235754 Aug 24 08:08:20.501398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 856/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1230 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:20.581725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 810c41f4-f7ab-43b6-bbdb-81d52de49f0d {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:20.671996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Request method failure captured: Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 HTTP/1.1 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdl1Qn076i86puRCzMLA3WTs3HXoAiWMhPnNkO458eXmJQXX7F1JYuB2H93kTtMjeP3CnoDjcg3CEwUpx5WnLBcuIs7An_vDtJYUKjhT2j0Z5Oeo1xJHC6tkZDD7aCR5qD2v5JO6eLiwqR__ITswAZEGMSAvgVCida8AGo4JNASY8ng Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:08:20.674189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}] Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: ab1a288170374d1a80355c869c78b4ca Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:20.675822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '810c41f4-f7ab-43b6-bbdb-81d52de49f0d', 'id': '75f8d53c-d72e-4a92-a270-4910c26a39c2'} Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:20.676633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:20.677883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.679305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.680584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) Aug 24 08:08:20.682729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.689582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e153c60-9c50-4b2f-b237-157858c770cb) {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:20.689582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6c0ba22d-7113-44e0-9a26-131e30f71ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2" status: 400 len: 269 microversion: 2.1 time: 0.310749 Aug 24 08:08:20.689582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 789/1645] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:08:20 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 => generated 269 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:08:20.691971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.692582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.698850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.699328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.700013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.700933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.701494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.701917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.706502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.707312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.715348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.716625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.717437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.718133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.718584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.720139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.906659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:20.906659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8c2685b-f80c-40a0-8437-624d6a2c78f6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1444 microversion: 2.1 time: 0.194390 Aug 24 08:08:20.906659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 790/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:20 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1444 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb HTTP/1.1 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:20.907997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:20.911639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '77aa9852-e8b2-470f-aeb4-e4e442384feb'} Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:20.913448 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:20.916464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:20.929413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:20.929413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1fa8a434-9af3-447f-b629-aca0fbeb7668 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 404 len: 111 microversion: 2.1 time: 0.395358 Aug 24 08:08:20.929413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 857/1647] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:08:20 2022] DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 111 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:20.930409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.930409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.930628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:20.930628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:20.930810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.930810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.930810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.930810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.931149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.931149 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.931301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.931301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.931301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.931301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.931613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.931613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.963371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:20.964051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:20.964690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:20.965335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lazy-loading 'fault' on Instance uuid 996f4b36-7aa5-49d2-b619-ef9af95054de {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:21.011501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:21.024370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d2bd36ed-8321-4b40-b8f3-4df92ec16a44 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1230 microversion: 2.1 time: 0.137121 Aug 24 08:08:21.025324 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 791/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:20 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:21.032896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 810c41f4-f7ab-43b6-bbdb-81d52de49f0d {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:21.033138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.033844 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.040494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.041344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.041992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.042892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.043552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.044207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.128601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.132701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Request method failure captured: Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 HTTP/1.1 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdl1Qn076i86puRCzMLA3WTs3HXoAiWMhPnNkO458eXmJQXX7F1JYuB2H93kTtMjeP3CnoDjcg3CEwUpx5WnLBcuIs7An_vDtJYUKjhT2j0Z5Oeo1xJHC6tkZDD7aCR5qD2v5JO6eLiwqR__ITswAZEGMSAvgVCida8AGo4JNASY8ng Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:21.132869 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}] Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: ab1a288170374d1a80355c869c78b4ca Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:21.134489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'server_id': '810c41f4-f7ab-43b6-bbdb-81d52de49f0d', 'id': '75f8d53c-d72e-4a92-a270-4910c26a39c2'} Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:21.135252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:21.137260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.140435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.142855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) Aug 24 08:08:21.146855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.149065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5094bb2c-0b15-4408-bd72-68939a6276be) {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.149065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-de6cfe0d-b8bf-4a51-808c-ecf8fcbe674f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2" status: 400 len: 269 microversion: 2.1 time: 0.233755 Aug 24 08:08:21.149065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 858/1649] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:08:20 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 => generated 269 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:08:21.149065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.149610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.149757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e4393a07-584f-4d1a-8447-0dbffd617fbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1376 microversion: 2.1 time: 0.117981 Aug 24 08:08:21.149757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 792/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1376 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:21.150855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.151351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.151864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.152327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.152556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.152974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.153144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.154434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.162107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.163210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.163828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.164798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.165254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.165670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.168576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb HTTP/1.1 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:21.171029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.172463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '77aa9852-e8b2-470f-aeb4-e4e442384feb'} Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.173275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.174880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.177327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.177327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8a8ff906-fd3c-4099-a055-e0ed17ed4510 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 404 len: 111 microversion: 2.1 time: 0.036627 Aug 24 08:08:21.177327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 859/1651] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:08:21 2022] DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:21.177996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.178475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.190085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.190085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.190085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.190085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.190542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.190542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.201153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.201763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.202193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.202629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lazy-loading 'fault' on Instance uuid 996f4b36-7aa5-49d2-b619-ef9af95054de {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:21.252064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:21.260517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f35fee40-9cab-4995-bfae-f9a76a24c721 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1230 microversion: 2.1 time: 0.112512 Aug 24 08:08:21.261511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 793/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:21.267779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.268598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.275427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.275636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.objects.instance [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lazy-loading 'services' on Instance uuid 810c41f4-f7ab-43b6-bbdb-81d52de49f0d {{(pid=132893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:21.276121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.276121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.276933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.277378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.277794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.338233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Request method failure captured: Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 HTTP/1.1 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdl1Qn076i86puRCzMLA3WTs3HXoAiWMhPnNkO458eXmJQXX7F1JYuB2H93kTtMjeP3CnoDjcg3CEwUpx5WnLBcuIs7An_vDtJYUKjhT2j0Z5Oeo1xJHC6tkZDD7aCR5qD2v5JO6eLiwqR__ITswAZEGMSAvgVCida8AGo4JNASY8ng Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:21.340401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05b468fa5d3046ebb37fbd43102be471"}]}] Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 05b468fa5d3046ebb37fbd43102be471 Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112003404 Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: ab1a288170374d1a80355c869c78b4ca Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112003404-project Aug 24 08:08:21.341837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'server_id': '810c41f4-f7ab-43b6-bbdb-81d52de49f0d', 'id': '75f8d53c-d72e-4a92-a270-4910c26a39c2'} Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:21.342503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:08:21.343621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.346199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.348180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) Aug 24 08:08:21.349588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.351764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bac14ef-1a51-41ce-9895-8f4d9d1ce3e9) {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.351764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-aae3f519-9bd0-4f34-9d28-862288d4c473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2" status: 400 len: 269 microversion: 2.1 time: 0.168047 Aug 24 08:08:21.351764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 860/1653] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:08:21 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d/os-volume_attachments/75f8d53c-d72e-4a92-a270-4910c26a39c2 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:08:21.357971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.359729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:21.359878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.366375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.366855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.367065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f4eb9fb6-bb6d-48e5-8692-59d650e566fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.104243 Aug 24 08:08:21.367312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.367641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 794/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:21.372940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.373949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.381345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.381893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.382493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.384802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.385515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.385948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.386716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.388827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.391450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.412253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb HTTP/1.1 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:21.413832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.415258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '77aa9852-e8b2-470f-aeb4-e4e442384feb'} Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.416161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.417805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.419731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.419731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a2289506-4019-4e55-8297-35fbee3fc087 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 404 len: 111 microversion: 2.1 time: 0.070458 Aug 24 08:08:21.419731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 861/1655] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:08:21 2022] DELETE /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:21.433113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.433605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.434331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.434632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lazy-loading 'fault' on Instance uuid 996f4b36-7aa5-49d2-b619-ef9af95054de {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:08:21.491456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4f3bfb16c6418cbdc1b6e8d4457a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b31c186fea438d9d17af25036099e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:21.502034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b6cf90e-ac65-447d-8543-3bf211fc0076 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 200 len: 1230 microversion: 2.1 time: 0.133189 Aug 24 08:08:21.503156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 795/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 1230 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:21.507958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.508715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 77aa9852-e8b2-470f-aeb4-e4e442384feb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.523137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.524277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.524925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.526012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.527223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.527869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.545623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb HTTP/1.1 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:08:21.547215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.548568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '77aa9852-e8b2-470f-aeb4-e4e442384feb'} Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.549503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. Aug 24 08:08:21.551222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.552792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 77aa9852-e8b2-470f-aeb4-e4e442384feb could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.552792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1516f33e-7e63-4468-8ad7-838bb17fb5bb tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb" status: 404 len: 111 microversion: 2.1 time: 0.044259 Aug 24 08:08:21.552792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 796/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/77aa9852-e8b2-470f-aeb4-e4e442384feb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:21.558202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.558699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.565374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.566088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.566679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.567435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.567875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.568637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.582838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a HTTP/1.1 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:08:21.584069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.585576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '16139508-8460-4a57-897f-5bcd03173a4a'} Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.586433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.587910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.589193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.589193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-044a666c-e900-48a3-a910-f8c7e3bf4da9 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 404 len: 111 microversion: 2.1 time: 0.031909 Aug 24 08:08:21.589193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 797/1658] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:08:21 2022] DELETE /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:08:21.596231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:21.596231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: 16139508-8460-4a57-897f-5bcd03173a4a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:21.603302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.603862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.604299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.605027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.605150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac1cc68-c627-403b-b458-375093efed24", "name": "network-vif-deleted", "tag": "1d0b596b-0e9f-40d1-a264-c7b68a74a3ab"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:21.605471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.605888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.615431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:21.616605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:21.616605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:21.621502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a HTTP/1.1 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:08:21.623621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.625105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '16139508-8460-4a57-897f-5bcd03173a4a'} Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:21.625861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. Aug 24 08:08:21.627140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:08:21.628260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance 16139508-8460-4a57-897f-5bcd03173a4a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:21.628260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bd00fd01-7f61-43d1-9a80-2aea95045ae6 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a" status: 404 len: 111 microversion: 2.1 time: 0.034345 Aug 24 08:08:21.628260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 798/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:21 2022] GET /compute/v2.1/servers/16139508-8460-4a57-897f-5bcd03173a4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:08:21.630784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] Creating event network-vif-deleted:1d0b596b-0e9f-40d1-a264-c7b68a74a3ab for instance 0ac1cc68-c627-403b-b458-375093efed24 on hv-cinder-85427 Aug 24 08:08:21.635526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-8abe8fff-09ae-4e9c-a705-9393f808efdf req-97c97380-90ba-4104-b112-16dec30b3101 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208665 Aug 24 08:08:21.636393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 862/1660] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:22.391563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:22.392259 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:22.398319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:22.400392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:22.400392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:22.400392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:22.400392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:22.400875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:22.463962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:22.471819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-75b9c306-74d9-4a1f-acd2-a1895fb6d1e0 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084731 Aug 24 08:08:22.472395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 799/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:22 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:22.529640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:22.530346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] [instance: 996f4b36-7aa5-49d2-b619-ef9af95054de] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:22.536496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:22.537003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:22.537431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:22.538221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:22.538697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:22.539117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:22.552853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] HTTP exception thrown: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Request method failure captured: Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de HTTP/1.1 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdkQxkchOTw7HQ7IMN0F-YQTRdns7Dt0M7M6vWU7EIAFhNmCdZu4Qw4_Mnqmh_nRxFMWTb5R9C52kwvYmm2Cafa3JL6yt0jI1VgXALellt39HC_tJRZJyDBdgvxjjz-HSCVVZoF9a0xxcqGt3uOWqeY9z0_B4PnEl_w8KKAe25yEBwc Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 65b31c186fea438d9d17af25036099e4 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-TestVolumeBootPattern-2083060908 Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:08:22.554409 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65b31c186fea438d9d17af25036099e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65b31c186fea438d9d17af25036099e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65b31c186fea438d9d17af25036099e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65b31c186fea438d9d17af25036099e4"}]}] Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-TestVolumeBootPattern-2083060908 Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 65b31c186fea438d9d17af25036099e4 Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083060908 Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-TestVolumeBootPattern-2083060908-project Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 9a4f3bfb16c6418cbdc1b6e8d4457a9a Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-TestVolumeBootPattern-2083060908-project Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. Aug 24 08:08:22.556159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '996f4b36-7aa5-49d2-b619-ef9af95054de'} Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:08:22.562019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. Aug 24 08:08:22.563644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:08:22.564884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Returning 404 to user: Instance 996f4b36-7aa5-49d2-b619-ef9af95054de could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:08:22.564884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-942aed65-d41a-46f3-93bf-fbe7c97645d3 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de" status: 404 len: 111 microversion: 2.1 time: 0.031280 Aug 24 08:08:22.564884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 863/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:22 2022] GET /compute/v2.1/servers/996f4b36-7aa5-49d2-b619-ef9af95054de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:23.491877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:23.492556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:23.499333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:23.499808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:23.500244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:23.500960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:23.501408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:23.501829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:23.565325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:23.573181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9720c2a5-93a2-417a-92f1-d0ed6d8b2c5a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.085088 Aug 24 08:08:23.573800 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 800/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:23 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:24.595601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:24.596207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:24.602668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:24.603139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:24.603558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:24.604235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:24.604695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:24.605111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:24.668199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:24.676467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7ee90de7-39f1-47a3-aaa9-9fe3e693e752 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084943 Aug 24 08:08:24.676989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 864/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:24 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:25.696878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:25.697490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:25.704147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:25.704622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:25.705093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:25.705777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:25.706255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:25.706678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:25.770802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:25.778657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c39d890f-d59d-491a-ad72-a9d9ce0598fa tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.085495 Aug 24 08:08:25.779252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 801/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:25 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:26.799373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:26.799912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:26.806235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:26.806712 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:26.807139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:26.807814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:26.808258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:26.808698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:26.869115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:26.877455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c7fbcd70-ae11-4454-a19b-2ea56d926adf tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081996 Aug 24 08:08:26.878013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 865/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:26 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:27.897523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:27.898130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:27.904503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:27.905011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:27.905451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:27.906130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:27.906575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:27.906994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:27.967871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:27.975584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-755e47f5-0a00-4862-b0d0-8ef448194d59 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081923 Aug 24 08:08:27.976147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 802/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:27 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:28.996576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:28.997216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:29.003751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:29.004224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:29.004667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:29.005392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:29.005841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:29.006258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:29.066974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:29.074707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dcb78d5d-be3c-4edc-8b98-b91a3dc659ad tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082037 Aug 24 08:08:29.075260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 866/1668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:28 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:30.095167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:30.095773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:30.102388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:30.102864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:30.103294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:30.103977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:30.104429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:30.104872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:30.166264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:30.174825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-20c5e3e0-e48a-42f2-b5d0-141300f709eb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083492 Aug 24 08:08:30.175392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 803/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:30 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:31.196764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:31.197367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:31.204860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:31.205332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:31.205786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:31.206462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:31.206942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:31.207355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:31.271331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:31.292492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d706fd2a-7112-4be5-81a0-e49d2b5e38a7 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086155 Aug 24 08:08:31.292492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 867/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:31 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:32.299590 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:32.300191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:32.306779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:32.307247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:32.307814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:32.308500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:32.308973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:32.309388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:32.373768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:32.381548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0bf58db4-2ef8-45e8-b464-8960498b80c9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086071 Aug 24 08:08:32.382126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 804/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:32 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:33.402770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:33.403390 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:33.410348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:33.410818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:33.411240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:33.411914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:33.412355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:33.412867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:33.726704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:33.734503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-433f9c0e-1a12-492a-bddf-459475bfeb53 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.335599 Aug 24 08:08:33.735091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 868/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:33 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:34.755486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:34.756002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:34.762551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:34.763024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:34.763457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:34.764167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:34.764615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:34.765063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:34.768973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:34.829381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:34.837093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-76b0fda1-c194-4495-b1c8-f938cdfb1416 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.085575 Aug 24 08:08:34.837657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 805/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:34 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:35.858449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:35.859056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:35.866039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:35.866514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:35.866971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:35.867660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:35.868129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:35.868568 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:35.928594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:35.937022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f73a1af-4ab7-444c-8212-333241aa31d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081604 Aug 24 08:08:35.937579 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 869/1674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:35 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:36.957966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:36.958610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:36.965038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:36.965518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:36.965953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:36.966638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:36.967819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:36.968254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:37.029274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:37.038073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6bf14fb2-a246-42c6-b8d0-a2ee4cc77196 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083960 Aug 24 08:08:37.038662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 806/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:36 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:38.059263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:38.059877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:38.066734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:38.067210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:38.067639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:38.068319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:38.068801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:38.069216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:38.131294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:38.138993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5dcff3ed-9bcf-4ed9-aacf-85aaccea9c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083650 Aug 24 08:08:38.146748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 870/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:38 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:39.159710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:39.160321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:39.166834 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:39.167310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:39.167741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:39.168422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:39.168894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:39.169316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:39.230221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:39.238564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-74ec0df4-1293-48ad-8c74-77c9d993e9b3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082992 Aug 24 08:08:39.239128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 807/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:39 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:40.259323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:40.259925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:40.266962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:40.267436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:40.267860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:40.268533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:40.269011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:40.269428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:40.329909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:40.337724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b357e817-1e0e-42d6-b44e-005e4be8eb48 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082263 Aug 24 08:08:40.338282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 871/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:40 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:41.358538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:41.359183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:41.365677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:41.366153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:41.366586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:41.367270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:41.367714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:41.368130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:41.431451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:41.439467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0c4c2f31-7dde-4cb7-90a0-3d1b41af4e34 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.085084 Aug 24 08:08:41.440033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 808/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:41 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:42.460955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:42.461590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:42.468113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:42.468543 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:42.468996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:42.469674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:42.470123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:42.470610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:42.533991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:42.541761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-db8842d8-a184-4aba-817e-0708457a5c4e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084852 Aug 24 08:08:42.542308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 872/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:42 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:43.563700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:43.564334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:43.570666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:43.571137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:43.571565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:43.572233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:43.572693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:43.573108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:43.636394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:43.644201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-02a3456c-5343-437b-a871-f8b30d553425 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084995 Aug 24 08:08:43.644790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 809/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:43 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:44.663858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:44.664495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:44.670973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:44.671446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:44.671885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:44.672590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:44.673066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:44.673514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:44.734506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:44.742186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-31da49b7-4fb5-46c9-ad5d-cfaa5da2c73e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082200 Aug 24 08:08:44.742746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 873/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:44 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:45.763263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:45.764434 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:45.770948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:45.771424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:45.771860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:45.772544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:45.773023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:45.773451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:45.835327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:45.843598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9df9abee-bdd6-4ca6-adfd-a8d60e0a5463 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084225 Aug 24 08:08:45.844256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 810/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:45 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:46.864950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:46.865557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:46.871928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:46.872392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:46.872856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:46.873745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:46.874193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:46.874607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:46.891952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:46.935528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:46.943557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f1e5463a-1635-4792-8319-0565c85b026c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082472 Aug 24 08:08:46.944114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 874/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:46 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:08:47.964400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:47.965028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:47.971684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:47.972160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:47.972597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:47.973278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:47.973716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:47.974124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:48.034445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:48.042094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-61f40653-3aec-45d9-91a1-8e86d622bf24 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081508 Aug 24 08:08:48.042656 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 811/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:47 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:48.411733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:08:48.411947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:08:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:08:49.063689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:49.064327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:49.071489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:49.071959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:49.072385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:49.073127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:49.073573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:49.073986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:49.134522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:49.143051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-158e97b2-e705-4349-88b8-e74a36379650 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083632 Aug 24 08:08:49.143604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 875/1686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:49 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:50.163433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:50.164188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:50.166432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=55 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:50.172071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:50.172542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:50.173062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:50.173808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:50.174252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:50.174666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:50.236371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:50.244042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8d7195f-2cc3-450e-914d-56afe390e6dc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084472 Aug 24 08:08:50.245957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 812/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:50 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:51.264678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:51.265276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:51.267576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=43 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:51.272223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:51.272723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:51.273152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:51.273831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:51.274273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:51.274688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:51.338104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:51.346551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a534cee1-002f-444c-b90a-cb16b18da673 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.085716 Aug 24 08:08:51.347114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 876/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:51 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:52.367447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:52.368090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:52.375295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.375847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:52.376282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:52.376992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.377441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:52.377856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:52.442171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:52.450049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d18b4df8-2416-4e89-8071-863ad8cccd5d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086476 Aug 24 08:08:52.450610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 813/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:52 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:53.472011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:53.472600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:53.478996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:53.479463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:53.479882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:53.480554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:53.481018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:53.481430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:53.544457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:53.552316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a573952f-890b-48ef-9b12-caeb00a41cbb tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084377 Aug 24 08:08:53.552906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 877/1690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:53 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:54.572983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:54.573623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:54.580747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:54.581225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:54.581654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:54.582336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:54.582789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:54.583207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:54.646117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:54.653737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-89defc6c-a10c-4eb4-8712-1e38eb851ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.084596 Aug 24 08:08:54.654363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 814/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:54 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:55.674619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:55.675218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:55.681784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:55.682289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:55.682717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:55.683393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:55.683837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:55.684251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:55.745864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:55.754170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5cc728bb-7d35-4b8d-ab23-534ffb66529a tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083500 Aug 24 08:08:55.754730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 878/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:55 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:56.774911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:56.775515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:56.782248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:56.782771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:56.783147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:56.783832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:56.784276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:56.784719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:56.845717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:56.853364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3be1fcb7-dba8-49ed-9031-ebbcacfc682e tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082388 Aug 24 08:08:56.853922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 815/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:56 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:58.033310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:58.033915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:58.039727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:58.040193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:58.040612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:58.041309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:58.041749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:58.042160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:58.103186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:58.111064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a431dc2b-dcf7-40b3-bbaa-ce26edaa022f tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.240650 Aug 24 08:08:58.111616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 879/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:57 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:59.132217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:59.132885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:59.139876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:59.140344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:59.140790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:59.141469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:59.141912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:59.142325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:59.203628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:59.211349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fdcb0be8-f668-4da3-901c-234ac3c429a9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082978 Aug 24 08:08:59.211920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 816/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:59 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:00.231337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:00.231931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:00.239109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:00.239614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:00.240038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:00.240737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:00.241179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:00.241594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:00.305045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:00.313811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd0195e3-76ef-4c1b-b502-daa704f73ef2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086364 Aug 24 08:09:00.314367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 880/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:00 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:00.835583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:09:00.836130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:09:01.334420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:01.335024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:01.341582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:01.342055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:01.342478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:01.343145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:01.343587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:01.343997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:01.409509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:01.417303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-98af3a74-0e09-46ca-95e9-9380d404d17d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086828 Aug 24 08:09:01.417860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 817/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:01 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:02.438370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:02.439264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:02.445821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:02.446329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:02.446780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:02.447464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:02.447908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:02.448330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:02.509580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:02.517870 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9da3380d-bfe8-42d2-8c53-e9c813aa04f3 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083607 Aug 24 08:09:02.518432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 881/1698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:02 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:03.538142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:03.538754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:03.545528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:03.546040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:03.546479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:03.547218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:03.547672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:03.548094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:03.609003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:03.617460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b303296-6ca9-4a9a-b026-b1b1345402d2 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083204 Aug 24 08:09:03.618013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 818/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:03 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:04.637469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:04.638075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:04.645354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:04.645820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:04.646289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:04.646952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:04.647389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:04.647806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:04.708030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:04.715575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6cd192fe-2652-4479-bcd1-22e2b50ed786 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081925 Aug 24 08:09:04.716131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 882/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:04 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:05.735793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:05.736397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:05.742926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:05.743393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:05.743820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:05.744491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:05.744957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:05.745370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:05.749200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=83 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:05.805865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:05.813743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1af55c8c-7462-4caa-8cc4-73447a1732f1 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081816 Aug 24 08:09:05.814300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 819/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:05 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:06.834556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:06.835166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:06.842030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:06.842506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:06.842935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:06.843614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:06.844058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:06.844474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:06.906858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:06.914574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c398e3fe-2495-45e8-b4ca-32fae2ac8d91 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083956 Aug 24 08:09:06.915140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 883/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:06 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:07.937044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:07.937653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:07.945090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:07.945566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:07.945997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:07.946672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:07.947124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:07.947536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:08.008219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:08.015874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d9439b11-d8a3-45c9-a16d-40a37aa295b6 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082961 Aug 24 08:09:08.016429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 820/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:07 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:09.036628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:09.037247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:09.043695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:09.044167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:09.044587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:09.045281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:09.045720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:09.046127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:09.108955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:09.116594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d0d02ff-ff52-43f3-bd73-86ba66b008b9 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083794 Aug 24 08:09:09.117174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 884/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:09 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:10.137343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:10.137951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:10.144330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:10.144973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:10.145410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:10.146092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:10.146539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:10.146949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:10.214328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:10.222264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6359035e-d501-4a2b-aa5d-d5d76376a061 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.088727 Aug 24 08:09:10.222837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 821/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:10 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:11.241838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:11.242434 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:11.248761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:11.249238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:11.249660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:11.250326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:11.250764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:11.251172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:11.311611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:11.319795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b1c0a0a7-9f22-4619-8b65-e3c546a36c03 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.081810 Aug 24 08:09:11.320355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 885/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:11 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:12.341083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:12.341694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:12.348188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:12.348681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:12.349137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:12.349819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:12.350265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:12.350697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:12.411729 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:12.419321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-08239d4a-8a3d-4ce6-b45f-626ea1fddcbc tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082071 Aug 24 08:09:12.419876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 822/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:12 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:13.441666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:13.442252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:13.448394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:13.448903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:13.449328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:13.449999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:13.450438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:13.450847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:13.511160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:13.519675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b45fac3-d71e-4380-a827-83ee370b4711 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.082848 Aug 24 08:09:13.520229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 886/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:13 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:14.540244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:14.540883 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:14.547479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:14.547954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:14.548383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:14.549088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:14.549650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:14.550091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:14.611789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:14.619750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0316b684-c71a-4eec-9a4e-f8bdfa100c0c tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083580 Aug 24 08:09:14.620337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 823/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:14 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:15.641805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:15.642576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:15.649781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:15.650370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:15.650799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:15.651493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:15.651953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:15.652364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:15.715335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:15.723765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b763eda-088b-4fc4-94a7-2a09e8bced36 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.086784 Aug 24 08:09:15.724329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 887/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:15 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:16.744024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:16.744635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] [instance: 0ac1cc68-c627-403b-b458-375093efed24] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:16.751028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:16.751505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:16.751936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:16.753420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:16.753886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:16.754305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:16.815733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3a2203128f46528a40a9f55b54b5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8ee42f4d499499f24e29d7a8249d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:16.823583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-003a372f-3d9b-4ef3-93e2-7349332f969d tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24" status: 200 len: 1214 microversion: 2.1 time: 0.083449 Aug 24 08:09:16.824148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 824/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:16 2022] GET /compute/v2.1/servers/0ac1cc68-c627-403b-b458-375093efed24 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:17.054839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-73ca08b9-bfee-4b95-bdf2-ec114efb6666 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] Calling method '.version_select at 0x7f456b6e09d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:17.160193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-73ca08b9-bfee-4b95-bdf2-ec114efb6666 tempest-TestShelveInstance-1343746081 tempest-TestShelveInstance-1343746081-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1393284113" status: 202 len: 0 microversion: 2.1 time: 0.109167 Aug 24 08:09:17.160845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 888/1712] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Aug 24 08:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1393284113 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:10:23.142613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:10:23.143306 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:10:32.985406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:10:32.985934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:10:43.204422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:10:43.205009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:11:54.916181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:11:54.916892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:12:08.420141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:12:08.420709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:12:20.843821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:12:20.844485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:12:22.743984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0698dc08-4e6c-4a98-96df-36f9deaf2d33] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 08:12:22.744837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=25 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:22.745564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=35 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:22.749444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:22.754315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:22.756181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:22.756671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:22.757127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:22.758011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:22.758456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:22.758877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:22.773000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 HTTP/1.1 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:12:22.774704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '72d25948-e2ff-41c2-81d7-c9912a94ec45'} Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:22.783014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.785168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.786764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:22.786764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-69523c9e-8dc4-46eb-bb7f-506d9f18e5f5 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 404 len: 111 microversion: 2.1 time: 0.034047 Aug 24 08:12:22.786764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 825/1713] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:12:22 2022] DELETE /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:22.788625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0b2c939-890e-444b-8836-1cbda914e1de] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:12:22.789315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=80 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:22.790050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:22.794175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:22.794774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 72d25948-e2ff-41c2-81d7-c9912a94ec45] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:22.810789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:22.811260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:22.811683 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:22.812369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:22.812840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:22.813257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:22.839966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 HTTP/1.1 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:12:22.841626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.843279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '72d25948-e2ff-41c2-81d7-c9912a94ec45'} Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:22.844238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. Aug 24 08:12:22.845890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:12:22.847700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 72d25948-e2ff-41c2-81d7-c9912a94ec45 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:22.847700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e0d505e5-777a-43c6-918c-098f18d0ddf6 tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45" status: 404 len: 111 microversion: 2.1 time: 0.058202 Aug 24 08:12:22.848818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 889/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:22 2022] GET /compute/v2.1/servers/72d25948-e2ff-41c2-81d7-c9912a94ec45 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:13:43.151750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:13:43.152558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:13:52.994685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:13:52.995299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:14:03.212752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:14:03.213347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:14:23.411962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:23.413330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:23.421476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:23.421955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:23.422386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:23.423076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:23.423527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:23.424137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:23.431579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] [0698dc08-4e6c-4a98-96df-36f9deaf2d33] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57968. Aug 24 08:14:23.451268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:14:23.833733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce0aa12d-06a3-4c0d-90fe-f7cd7cef6c27 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 204 len: 0 microversion: 2.1 time: 0.429965 Aug 24 08:14:23.834363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 826/1715] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:14:23 2022] DELETE /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:14:23.845922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:23.846532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:23.855264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:23.855742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:23.856175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:23.856911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:23.857356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:23.857772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:23.863027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0b2c939-890e-444b-8836-1cbda914e1de] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57980. Aug 24 08:14:24.135737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:24.146492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ee1494ce-1ef1-42d9-8850-f6e409598508 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.307240 Aug 24 08:14:24.147275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 890/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:25.168298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:25.169022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:25.175097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:25.175572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:25.176017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:25.177325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:25.177765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:25.178185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:25.518966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:25.529170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-399f2dbe-e256-4b13-9b85-38578953d384 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.364655 Aug 24 08:14:25.530320 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 827/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:26.554640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:26.555285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:26.561823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:26.562296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:26.562910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:26.563602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:26.564045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:26.564616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:26.717610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:26.726732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d388c30-4f90-465e-8434-b9cc8030bb89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.177637 Aug 24 08:14:26.727272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 891/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:27.748561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:27.749186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:27.756357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:27.757121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:27.757681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:27.758405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:27.758862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:27.759289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:27.892151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:27.901504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-def9428c-d135-4746-9111-b861feb2052b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156761 Aug 24 08:14:27.902169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 828/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:28.922124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:28.922727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:28.929666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:28.930136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:28.930561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:28.931512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:28.931955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:28.932370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:29.062861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:29.071219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e41d4a80-8007-4de3-a5af-d638d504cfd8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152963 Aug 24 08:14:29.071770 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 892/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:28 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:30.092213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:30.092845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:30.099823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:30.100300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:30.100756 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:30.101445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:30.101892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:30.102310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:30.234066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:30.243154 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6009d026-7dca-4e31-b17e-5ac7977b9ca1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154860 Aug 24 08:14:30.243708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 829/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:30 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:31.264352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:31.264979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:31.272759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:31.273236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:31.273657 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:31.274338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:31.274773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:31.275184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:31.406078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:31.414551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e06930a8-81bb-4477-ad32-f19a0d87ad34 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154010 Aug 24 08:14:31.415102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 893/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:32.436082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:32.436801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:32.443164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:32.443638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:32.444069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:32.444791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:32.445235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:32.445657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:32.573628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:32.581816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b38a609-47d8-4981-923d-9d4cc0e70f48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149624 Aug 24 08:14:32.582390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 830/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:14:33.603017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:33.603615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:33.609959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:33.610453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:33.611105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:33.611778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:33.612217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:33.612626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:33.744221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:33.752297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4d02b5ab-06f2-44a0-ba49-8f42d03e9e50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153091 Aug 24 08:14:33.752868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 894/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:34.774747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:34.775353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:34.781869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:34.782386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:34.782764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:34.783439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:34.783880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:34.784292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:34.914274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:34.922583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-856be2b8-f434-4dfe-bd28-7d32c675d070 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151501 Aug 24 08:14:34.922978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 831/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:34 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:35.944779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:35.945392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:35.951988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:35.952465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:35.952921 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:35.953601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:35.954127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:35.954549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:36.086567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:36.095037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8d52d8b8-59f1-4116-885c-28b6b871da61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154327 Aug 24 08:14:36.095679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 895/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:37.116527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:37.117161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:37.123481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:37.123954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:37.124384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:37.125106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:37.125554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:37.125968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:37.258748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:37.267076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-06cc34be-9866-41d0-8da4-98db7edd1995 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154479 Aug 24 08:14:37.267830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 832/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:37 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:38.289360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:38.289957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:38.296339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:38.296865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:38.297301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:38.297990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:38.298440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:38.298861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:38.434218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:38.443768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-74e62134-100b-4a47-a327-6f0a4c8d548f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157725 Aug 24 08:14:38.443768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 896/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:39.464986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:39.465636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:39.472032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:39.472510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:39.472990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:39.474385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:39.474840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:39.475266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:39.608817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:39.617124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9b34e029-2ac5-4808-ae0b-2bd166efe84f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157064 Aug 24 08:14:39.617617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 833/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:40.637931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:40.638565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:40.645013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:40.645558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:40.645986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:40.646660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:40.647102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:40.647512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:40.781708 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:40.790635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-90f65cfd-4364-40a3-942e-e4f78c8639ef tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156556 Aug 24 08:14:40.791192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 897/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:40 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:41.812413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:41.813051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:41.820296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:41.820796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:41.821221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:41.821892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:41.822333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:41.822738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:41.951926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:41.961311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e44b79f3-12c1-42e1-9ad2-a2795115b1d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152239 Aug 24 08:14:41.965907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 834/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:41 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:42.981486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:42.982105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:42.988471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:42.989123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:42.989584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:42.990310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:42.990785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:42.991198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:43.117155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:43.125385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-638772d5-7330-4ff4-8cd3-e1bced1b973a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.147737 Aug 24 08:14:43.125941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 898/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:44.146669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:44.147289 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:44.153889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:44.154359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:44.154782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:44.155454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:44.155894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:44.156308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:44.286173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:44.294381 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-842ddf9f-8994-4bac-b338-5c1c9ba6c3e1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152076 Aug 24 08:14:44.294950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 835/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:44 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:45.315405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:45.316004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:45.322837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:45.323303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:45.323725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:45.324395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:45.324862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:45.325277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:45.458882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:45.467449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7cec0976-efc2-4afb-91ba-95308e93d7eb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155911 Aug 24 08:14:45.468006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 899/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:46.489509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:46.490231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:46.496796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:46.497280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:46.497714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:46.498401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:46.498851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:46.499271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:46.630469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:46.638687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf1bd6de-4765-473b-bfcf-14fa6175aee3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153491 Aug 24 08:14:46.639262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 836/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:47.660087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:47.661334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:47.668133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:47.668605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:47.669056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:47.669730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:47.670170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:47.670581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:47.801082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:47.810017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a67a801b-302b-4b36-bdf0-43f92d67f990 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153754 Aug 24 08:14:47.810651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 900/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:48.831073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:48.831711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:48.838205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:48.838678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:48.839114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:48.839797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:48.840238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:48.840679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:48.969715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:48.978526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-035a59e8-7dcb-433e-931f-44d326c8c829 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151218 Aug 24 08:14:48.979096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 837/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:48 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:49.999252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:49.999865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:50.007076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:50.007554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:50.007991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:50.008705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:50.009166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:50.009588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:50.137754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:50.146066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1d27e7fb-859a-4fde-84d8-fa368049a211 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150589 Aug 24 08:14:50.146630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 901/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:51.167532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:51.168165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:51.174632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:51.175108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:51.175541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:51.176886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:51.177483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:51.177917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:51.309840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:51.318017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-436baf97-987f-47cb-b12b-d75bc9b123fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154297 Aug 24 08:14:51.318587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 838/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:51 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:52.339493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:52.340097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:52.346513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:52.346984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:52.347413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:52.348816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:52.349283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:52.349705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:52.480774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:52.488941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b7af4bd8-493a-462d-a80f-3bb20693e3fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153259 Aug 24 08:14:52.489507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 902/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:52 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:53.510218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:53.510909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:53.512913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:53.517617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:53.518094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:53.518527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:53.519209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:53.519654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:53.520118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:53.524244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:53.652837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:53.661526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5cd5e9aa-3e07-4841-a27e-29ecf6ad6374 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155236 Aug 24 08:14:53.662092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 839/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:54.683104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:54.683649 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:54.685699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=29 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:54.690372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:54.690843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:54.691275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:54.692180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:54.692634 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:54.693081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:54.696944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=81 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:54.821211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:54.829292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b136277-77ef-4f43-a8a5-b10aa76b1575 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150430 Aug 24 08:14:54.829860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 903/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:55.851301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:55.851914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:55.858350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:55.858827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:55.859257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:55.859942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:55.860389 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:55.860832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:55.993615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:56.001752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-66b68610-385b-4965-bce1-919bbdbe4a90 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154778 Aug 24 08:14:56.002318 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 840/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:55 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:57.023324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:57.023957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:57.030350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:57.030817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:57.031238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:57.031911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:57.032352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:57.032792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:57.166277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:57.174378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3e7cd054-1f2f-4264-ba91-d8beb9f547f4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155679 Aug 24 08:14:57.174937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 904/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:58.196223 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:58.196792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:58.203187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:58.203653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:58.204079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:58.204798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:58.205239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:58.205652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:58.348899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:58.357179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-395198fd-1fe5-4615-aa7e-86614e033ab9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.165714 Aug 24 08:14:58.369112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 841/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:14:59.382095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:14:59.382792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:14:59.389404 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:59.389878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:59.390302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:59.390983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:14:59.391482 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:14:59.391900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:14:59.522709 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:14:59.530867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a552e1f0-1594-4a34-ad52-5006b885d58b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153437 Aug 24 08:14:59.531437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 905/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:14:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:00.551245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:00.552029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:00.558691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:00.559199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:00.559633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:00.560323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:00.560796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:00.561218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:00.690263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:00.698430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf2b39e6-5f60-4b2b-b91d-bbd151f41a21 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151057 Aug 24 08:15:00.698986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 842/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:01.719802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:01.720356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:01.726724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:01.727194 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:01.727623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:01.728296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:01.728769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:01.729185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:01.858894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:01.867114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6964937f-63c0-4c1b-83d9-c7ed48711dc8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151195 Aug 24 08:15:01.867678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 906/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:02.889024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:02.889612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:02.896012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:02.896479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:02.896943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:02.897615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:02.898053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:02.898462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:03.027920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:03.036713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-79f94cf6-3dbb-452a-ae4c-cab5eba73ec7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151537 Aug 24 08:15:03.037277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 843/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:02 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:04.058065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:04.058773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:04.065151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:04.065625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:04.066057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:04.067370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:04.068050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:04.068472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:04.199865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:04.208192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-12c721ac-7da5-46f0-ac73-4ab780542e06 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154211 Aug 24 08:15:04.208777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 907/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:04 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:05.230342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:05.230945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:05.237589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:05.238053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:05.238643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:05.239327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:05.239773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:05.240189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:05.369008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:05.377160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f0db155-24ab-465d-a234-2c62cfa734a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150717 Aug 24 08:15:05.377725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 844/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:06.399992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:06.400611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:06.406925 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:06.407394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:06.407818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:06.408490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:06.408959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:06.409370 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:06.538225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:06.546539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1539f87d-be27-461c-9590-94e79ffb081d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150446 Aug 24 08:15:06.547105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 908/1752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:07.569534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:07.570144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:07.576509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:07.577019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:07.577446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:07.578121 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:07.578563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:07.578980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:07.709875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:07.718072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af418cc4-21f0-4489-a100-c24fb6b7f4e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153303 Aug 24 08:15:07.718639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 845/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:08.739907 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:08.740513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:08.746901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:08.747371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:08.747800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:08.748478 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:08.748956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:08.749373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:08.882349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:08.890804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4538a7f5-f2e4-48ff-81e2-969526975ac5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155396 Aug 24 08:15:08.891379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 909/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:09.911833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:09.912441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:09.918968 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:09.919445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:09.919877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:09.920559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:09.921110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:09.921535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:10.057093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:10.065445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6275554-4d1a-4a86-94a1-f7ff580d6df7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157476 Aug 24 08:15:10.066006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 846/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:09 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:11.086831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:11.087520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:11.093960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:11.094465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:11.094903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:11.095591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:11.096046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:11.096463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:11.226752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:11.234878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-be47887e-f8f3-4643-9bba-6ada884990d7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152519 Aug 24 08:15:11.235380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 910/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:12.255798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:12.256337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:12.262794 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:12.263266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:12.263697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:12.264379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:12.264861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:12.265288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:12.394989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:12.403609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d0d3326-8262-45d7-94eb-1674d0b2f6b7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152271 Aug 24 08:15:12.404185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 847/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:13.424693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:13.425234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:13.432141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:13.432608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:13.433052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:13.433722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:13.434161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:13.434573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:13.565207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:13.573866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d075a78f-45a0-4331-a4af-52511b2b381e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153040 Aug 24 08:15:13.574430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 911/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:14.595427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:14.596033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:14.602897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:14.603370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:14.603799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:14.604486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:14.604957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:14.605376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:14.736248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:14.745356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-601b88d5-6bc2-4ac3-abcb-0068ae587aee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153742 Aug 24 08:15:14.745939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 848/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:14.924437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:15:14.924952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:15:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:15:15.767180 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:15.767797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:15.775015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:15.775487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:15.775913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:15.776594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:15.777092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:15.777513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:15.903826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:15.912239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c11f742d-83c5-4864-992e-75fefb944192 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148920 Aug 24 08:15:15.912821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 912/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:16.933884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:16.934513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:16.942555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:16.943025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:16.943451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:16.944132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:16.944569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:16.945010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:17.086828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:17.095084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f0c2694a-f71b-417b-85cc-85a2dc1e60f2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.165363 Aug 24 08:15:17.095645 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 849/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:16 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:18.116670 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:18.117336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:18.123588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:18.124059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:18.124483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:18.125183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:18.125623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:18.126032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:18.254445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:18.262748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58584c47-210f-4c7b-ab57-f3971985275f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150564 Aug 24 08:15:18.263305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 913/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:18 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:19.283594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:19.284218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:19.291242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:19.291711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:19.292135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:19.292850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:19.293290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:19.293703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:19.425369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:19.433854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4839fe37-999d-45a3-9f8d-af9031aafe59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154070 Aug 24 08:15:19.434414 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 850/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:20.455398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:20.456002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:20.462457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:20.462929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:20.463357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:20.464034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:20.464481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:20.464924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:20.600340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:20.608696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6c73e7b-0e5b-4aae-8b11-1d99f116c885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157154 Aug 24 08:15:20.609273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 914/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:21.632109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:21.632747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:21.639517 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:21.639996 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:21.640461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:21.641234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:21.641680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:21.642098 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:21.774027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:21.782905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac382090-0fd6-47aa-92ae-41203ed40ef7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155555 Aug 24 08:15:21.783422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 851/1765] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:22.804910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:22.807285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:22.812331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:22.814807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:22.814807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:22.814807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:22.814807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:22.815223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:22.948453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:22.956673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4f81cbb1-f28f-428c-a567-aa458bb1642e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156150 Aug 24 08:15:22.957245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 915/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:22 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:23.978715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:23.979328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:23.981205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:23.985846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:23.986319 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:23.986748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:23.987422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:23.987865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:23.988313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:23.990849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=78 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:24.119911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:24.128268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0f919c18-c721-4cd5-97aa-3e66a8d45626 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154176 Aug 24 08:15:24.128860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 852/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:25.151179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:25.152181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:25.154051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:25.158765 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:25.159234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:25.159661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:25.160339 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:25.160819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:25.167795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:25.167795 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:25.292762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:25.300943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7b4b7adc-a7ee-4d72-a895-1fece5ccc525 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153841 Aug 24 08:15:25.301508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 916/1768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:26.322765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:26.323406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:26.330056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:26.330528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:26.330951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:26.331623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:26.332060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:26.332470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:26.467795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:26.476237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f1074ed-9410-475d-abb3-30f81a13331b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157321 Aug 24 08:15:26.477562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 853/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:27.498348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:27.498955 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:27.505239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:27.505656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:27.506081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:27.506767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:27.507258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:27.507613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:27.641239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:27.650032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c0840dc-86cc-4942-8a99-1542d8d3a1c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155482 Aug 24 08:15:27.650591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 917/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:28.428890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:15:28.429449 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:15:28.672037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:28.672663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:28.679276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:28.680184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:28.680927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:28.681821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:28.682270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:28.682689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:28.813531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:28.822420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c8e4ccd-ba6f-41b7-aab9-13f827c973e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154597 Aug 24 08:15:28.822984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 854/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:28 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:15:29.843617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:29.844232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:29.850653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:29.851124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:29.851620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:29.852688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:29.853135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:29.853547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:29.985501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:29.994469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-aa0c3357-6437-49bc-a936-93a3e0bd9164 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154689 Aug 24 08:15:29.995019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 918/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:29 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:31.015781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:31.016422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:31.022834 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:31.023315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:31.023953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:31.024667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:31.025114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:31.025535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:31.155679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:31.164687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-86787dd3-8c9b-4824-82c4-c6e468c5b3aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152173 Aug 24 08:15:31.165275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 855/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:32.186840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:32.187451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:32.193867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:32.194293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:32.194718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:32.196052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:32.196702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:32.197128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:32.326819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:32.337903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ad3b6de0-aef5-4e48-8a93-c8aa051fb33e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154771 Aug 24 08:15:32.338476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 919/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:33.359292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:33.359938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:33.366403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:33.366885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:33.368043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:33.368975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:33.369435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:33.369871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:33.523733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:33.532036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d118c8b1-3b22-450c-977b-de89b1af4e94 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.176609 Aug 24 08:15:33.532613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 856/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:34.553666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:34.554300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:34.561630 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:34.562105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:34.562526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:34.563197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:34.563635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:34.564047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:34.691341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:34.700268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ac2547d5-8d14-4d1b-96e5-644ce3e49b29 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150633 Aug 24 08:15:34.700860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 920/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:34 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:35.721341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:35.721878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:35.729020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:35.729498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:35.729934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:35.730620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:35.731068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:35.731487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:35.861158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:35.869942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b3a2e34d-d2e9-4d7f-8d56-7d423ab01be5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152565 Aug 24 08:15:35.870512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 857/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:36.891021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:36.891619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:36.898039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:36.898503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:36.898922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:36.899715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:36.900155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:36.900564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:37.037144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:37.045964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-43702566-6edd-4f7b-a168-b42b454336c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158724 Aug 24 08:15:37.046539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 921/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:36 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:38.067094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:38.067709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:38.074568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:38.075060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:38.075470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:38.076150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:38.076595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:38.077032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:38.204681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:38.213043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-debfe68f-9319-4793-9781-94315cc8e0ad tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149623 Aug 24 08:15:38.213634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 858/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:39.235396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:39.236003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:39.242435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:39.242906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:39.243331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:39.244503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:39.244978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:39.245472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:39.373654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:39.381844 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-142d9f19-d27e-490a-8726-56721229b219 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150349 Aug 24 08:15:39.382639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 922/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:40.401972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:40.402579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:40.409188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:40.409664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:40.410102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:40.410777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:40.411220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:40.411634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:40.539753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:40.548018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-02ebbdab-f852-4bbd-8bda-8cb927543885 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150008 Aug 24 08:15:40.548571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 859/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:40 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:41.570578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:41.571186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:41.578132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:41.578606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:41.579038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:41.579718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:41.580161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:41.580576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:41.713648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:41.721846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1624d44f-f646-4aac-882c-891f5544e054 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155149 Aug 24 08:15:41.722405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 923/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:41 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:42.742453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:42.743069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:42.749917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:42.750445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:42.750889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:42.751597 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:42.752068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:42.752485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:42.884927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:42.893176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-640d3b7a-8778-469d-a245-eb762bf1493c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154535 Aug 24 08:15:42.893738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 860/1783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:43.914943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:43.915546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:43.922233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:43.922704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:43.923130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:43.923807 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:43.924255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:43.924689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:44.059414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:44.067781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c1e9a9c4-b916-4742-abaf-b403bd0645b6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156676 Aug 24 08:15:44.068354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 924/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:43 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:45.090404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:45.091091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:45.097864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:45.098344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:45.098770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:45.099460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:45.099906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:45.100325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:45.227785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:45.236558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-15e29ee1-a97f-493a-ac95-a22729c4110c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150881 Aug 24 08:15:45.237145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 861/1785] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:46.258120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:46.258655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:46.266043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:46.266522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:46.266956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:46.267644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:46.268092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:46.268512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:46.395160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:46.404079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-281e1f13-1a67-4bb0-8156-19b101331f74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149841 Aug 24 08:15:46.404626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 925/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:47.426306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:47.426993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:47.434327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:47.440807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:47.440807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:47.440807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:47.440807 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:47.441205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:47.570444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:47.578696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee369090-5eb1-47bd-91cf-e24875af58e5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156334 Aug 24 08:15:47.579257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 862/1787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:48.599334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:48.599931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:48.606806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:48.607279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:48.607702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:48.608381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:48.608887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:48.609302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:48.742633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:48.751872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-03e980ee-fb7a-45ac-a5d6-77a740c54877 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156409 Aug 24 08:15:48.752436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 926/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:48 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:49.773622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:49.774230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:49.781332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:49.781796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:49.782218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:49.782938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:49.783335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:49.783795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:49.932294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:49.940494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-676ccf09-ce68-44ff-9afb-552a437c17bc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.170831 Aug 24 08:15:49.941084 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 863/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:50.962344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:50.963962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:50.970636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:50.971114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:50.971571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:50.972255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:50.972728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:50.973146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:51.099692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:51.108408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a2b18e42-5322-4f2b-acae-b43b2e136955 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149941 Aug 24 08:15:51.108990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 927/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:50 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:15:52.130042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:52.130644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:52.137522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:52.137992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:52.138418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:52.139090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:52.139529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:52.139941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:52.266753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:52.274929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c8a40298-b936-4c17-83b0-c2a64303491b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148763 Aug 24 08:15:52.275777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 864/1791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:52 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:53.295786 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:53.296389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:53.302783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:53.303252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:53.303676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:53.304344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:53.304820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:53.305492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:53.437349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:53.445695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a3a02871-3a8c-4bd4-bc3a-efb1c0fea2dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153700 Aug 24 08:15:53.446268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 928/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:54.468335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:54.468965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:54.470868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:54.475492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:54.475961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:54.476386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:54.477102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:54.477549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:54.483260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:54.483260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=78 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:54.616915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:54.626090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1998c5fd-c9a3-487c-9d16-6eb4cff55ee4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.161725 Aug 24 08:15:54.626663 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 865/1793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:55.649314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:55.650949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:55.653301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:55.658049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:55.658535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:55.658997 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:55.659891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:55.660343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:55.660823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:55.666625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:55.789958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:55.798248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-21166033-8176-4dd3-bf05-273a793a8eee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153322 Aug 24 08:15:55.798814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 929/1794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:55 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:56.818986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:56.819609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:56.826454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:56.826929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:56.827352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:56.828026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:56.828462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:56.828895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:56.958629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:56.967591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a76975d6-1fd7-4486-9ff3-eaec72ecd0f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152388 Aug 24 08:15:56.968142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 866/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:56 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:57.989326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:57.989777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:57.996758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:57.997260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:57.997684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:57.998360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:57.998797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:57.999209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:58.134168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:58.142528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-01820b5b-f1da-4e7e-8efb-42ea38f8a80d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157218 Aug 24 08:15:58.143108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 930/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:15:59.163206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:15:59.163815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:15:59.170180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:59.170654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:59.171082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:59.171789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:15:59.172233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:15:59.172670 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:15:59.303773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:15:59.312902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5593cbdd-726f-44b7-9535-f76162236c12 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153443 Aug 24 08:15:59.313456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 867/1797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:15:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:00.333906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:00.334450 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:00.341748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:00.342219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:00.342648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:00.343324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:00.343768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:00.344183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:00.471893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:00.480354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5132414c-4f12-4037-8d96-d4a74c359f53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150403 Aug 24 08:16:00.480952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 931/1798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:01.501379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:01.501974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:01.508444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:01.508943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:01.509369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:01.510142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:01.510528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:01.511055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:01.638428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:01.646579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0e56d7ce-a6d2-46fe-ab69-d128f3755518 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149456 Aug 24 08:16:01.647131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 868/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:16:02.668572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:02.669213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:02.675809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:02.676292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:02.676763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:02.677454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:02.677931 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:02.678353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:02.809175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:02.817338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f9fa4b99-0b53-45b6-a2ca-0796a6b9c2a2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152798 Aug 24 08:16:02.817906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 932/1800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:02 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:03.838795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:03.839402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:03.845765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:03.861032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:03.861032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:03.861032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:03.861032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:03.861433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:03.980978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:03.992091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-81a6c319-0263-42a3-8711-d2b31c46b4af tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156306 Aug 24 08:16:03.993005 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 869/1801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:05.014554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:05.015161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:05.021555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:05.022027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:05.022455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:05.023132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:05.023582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:05.023998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:05.164275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:05.173268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-98781996-f338-4f06-bf28-95835502ddbf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.162532 Aug 24 08:16:05.173951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 933/1802] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:06.195120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:06.195805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:06.202499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:06.202982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:06.203415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:06.204110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:06.204556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:06.205046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:06.341730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:06.349825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5477829f-4d15-4576-ad51-50261617217d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158735 Aug 24 08:16:06.350388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 870/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:07.371167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:07.371773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:07.378243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:07.378719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:07.379145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:07.379876 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:07.380317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:07.380801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:07.510682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:07.518755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c4972d47-31da-4b67-81d8-32a84625fd23 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152031 Aug 24 08:16:07.519308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 934/1804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:08.539185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:08.539790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:08.547074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:08.547541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:08.547964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:08.548634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:08.549275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:08.549688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:08.682724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:08.691039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-147db800-061f-49d5-8a40-5969390d396a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155579 Aug 24 08:16:08.691681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 871/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:09.712196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:09.712809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:09.719265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:09.719733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:09.720157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:09.720857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:09.721298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:09.721749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:09.851004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:09.859168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-332e9536-7db6-4fff-b555-9c55a344239c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150860 Aug 24 08:16:09.859724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 935/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:09 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:10.880565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:10.881204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:10.888011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:10.888485 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:10.888948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:10.889629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:10.890074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:10.890487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:11.021945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:11.030901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24b19be8-cb7c-4f11-a3fa-3590c3995473 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154166 Aug 24 08:16:11.031463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 872/1807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:10 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:12.052025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:12.052633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:12.059815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:12.060288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:12.060741 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:12.061431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:12.061915 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:12.062333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:12.191659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:12.200514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c38b2dc6-1c7b-4194-8cd5-a0307a395a61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152380 Aug 24 08:16:12.201118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 936/1808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:13.222138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:13.222731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:13.229406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:13.229881 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:13.230340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:13.231016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:13.231459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:13.231875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:13.356920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:13.365373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-48318261-73a1-4859-8da6-47e889027d13 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.147094 Aug 24 08:16:13.365940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 873/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:14.387038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:14.387641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:14.394024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:14.399102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:14.399102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:14.399102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:14.399102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:14.399662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:14.525185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:14.533943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f99eb418-70cb-4d2c-8e2d-039c674142c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150393 Aug 24 08:16:14.534111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 937/1810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:15.555452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:15.556065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:15.562671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:15.563141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:15.563575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:15.564263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:15.564743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:15.565169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:15.697531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:15.706601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-065aec89-e5a7-4e5e-bd37-db560340a98a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155260 Aug 24 08:16:15.710889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 874/1811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:16.727346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:16.727952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:16.734880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:16.735354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:16.735782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:16.736466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:16.736935 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:16.737354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:16.874389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:16.882539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-344d7df9-7234-4503-b9de-f54dc51aac63 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158998 Aug 24 08:16:16.883102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 938/1812] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:16 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:17.903348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:17.903955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:17.910327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:17.910801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:17.911236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:17.911912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:17.912355 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:17.912805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:18.041958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:18.050447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2df4cf39-be36-49c4-9103-e1b029e9c833 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151014 Aug 24 08:16:18.051010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 875/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:17 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:19.072170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:19.072809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:19.079284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:19.079761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:19.080197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:19.080985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:19.081435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:19.081856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:19.211221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:19.219719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25a8d714-404f-4ff5-8134-e26d81eba663 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151461 Aug 24 08:16:19.220294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 939/1814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:20.241337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:20.241875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:20.248917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:20.249422 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:20.249852 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:20.250530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:20.250978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:20.251398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:20.383218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:20.392233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6b083dd8-28a2-41d9-99ed-f2a414037f51 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154826 Aug 24 08:16:20.392829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 876/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:21.231061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8e4d0eb5-7c07-4ba2-91de-74e87de0aaa4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] Calling method '.version_select at 0x7f4562e47e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:21.318192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8e4d0eb5-7c07-4ba2-91de-74e87de0aaa4 tempest-TestVolumeBootPattern-2083060908 tempest-TestVolumeBootPattern-2083060908-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1569750893" status: 202 len: 0 microversion: 2.1 time: 0.091299 Aug 24 08:16:21.318777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 940/1816] 10.222.0.26 () {58 vars in 1263 bytes} [Wed Aug 24 08:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1569750893 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:16:21.413495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:21.414383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:21.421163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:21.421647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:21.422117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:21.422811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:21.423254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:21.423674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:21.569974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:21.578896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a1dd4ed9-1a95-4c24-a17a-ea70a635bf59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.169248 Aug 24 08:16:21.579468 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 877/1817] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:22.617528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:22.617528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:22.617528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:22.617528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:22.619143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:22.619143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:22.619143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:22.619143 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:22.889995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:22.898438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-21b7d878-0931-4c6e-92fc-92a5f7686a74 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.299764 Aug 24 08:16:22.899016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 941/1818] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:22 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:23.920025 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:23.920564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:23.926640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:23.927118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:23.927550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:23.928235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:23.928700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:23.932942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:24.371862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:24.380139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-614522e2-f3af-49d6-a07b-2711d4885a25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.464120 Aug 24 08:16:24.380728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 878/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:25.402263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:25.402862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:25.408952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:25.409612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:25.410036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:25.410716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:25.411155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:25.411566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:25.550085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:25.559347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-454b23e5-66db-49fa-b9ba-2d315caacfdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.161517 Aug 24 08:16:25.559914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 942/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:26.580272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:26.580930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:26.583242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:26.588085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:26.589299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:26.589812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:26.590535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:26.590985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:26.591409 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:26.594288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=84 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:26.743672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:26.753567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bee06f2f-ba2f-4ca2-80ae-ae64ae08d48a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.177308 Aug 24 08:16:26.754390 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 879/1821] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:27.775365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:27.776483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:27.778805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:27.783496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:27.783965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:27.784396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:27.785107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:27.785555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:27.785992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:27.788481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:28.074463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:28.082872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-67f8bf46-5a40-4eb9-b015-52b8d0455267 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.311446 Aug 24 08:16:28.083541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 943/1822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:29.106245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:29.106948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:29.115997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:29.116467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:29.116951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:29.117653 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:29.118102 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:29.118523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:29.316497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:29.325630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bce94412-cee5-4941-b816-b5c657bc3b17 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.225240 Aug 24 08:16:29.326629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 880/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:29 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:30.348388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:30.349089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:30.356574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:30.357089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:30.357520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:30.358241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:30.358687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:30.359103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:30.489865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:30.500429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30a3a640-aaf0-4e23-8340-1bbb48d57e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154786 Aug 24 08:16:30.500429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 944/1824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:30 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:31.520511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:31.521137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:31.528028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:31.528501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:31.528964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:31.529651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:31.530099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:31.530519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:31.663430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:31.672539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e13383cd-f483-40e8-898a-08bc23bc0d89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156005 Aug 24 08:16:31.673201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 881/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:32.705977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:32.707777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:32.715676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:32.716422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:32.716878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:32.717763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:32.718590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:32.719174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:32.852814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:32.861110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd2c8c45-cd44-42f1-8e32-f66bb2618e71 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158861 Aug 24 08:16:32.861727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 945/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:33.882909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:33.883514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:33.890246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:33.890888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:33.891124 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:33.891799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:33.892234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:33.892675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:34.021681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:34.030748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-10c9440e-845c-49de-beea-8f4dc224c190 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151767 Aug 24 08:16:34.031329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 882/1827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:35.051944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:35.052550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:35.059802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:35.060276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:35.060731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:35.061421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:35.061861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:35.062272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:35.196485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:35.204875 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b4affe4-0a8a-4d5c-9513-b42ea6dfcecf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156686 Aug 24 08:16:35.205441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 946/1828] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:36.226855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:36.227464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:36.234646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:36.235118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:36.235548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:36.236226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:36.236703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:36.237130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:36.366839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:36.375589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef3ffd06-5bdc-4fe6-85ee-57f061333290 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152606 Aug 24 08:16:36.376157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 883/1829] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:36 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:37.396858 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:37.397476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:37.404188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:37.404687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:37.405124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:37.405803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:37.406248 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:37.406676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:37.534179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:37.542797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a4d201b6-685e-4c34-8546-5552fee5f726 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149560 Aug 24 08:16:37.543460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 947/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:37 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:38.563441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:38.564060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:38.570459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:38.570939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:38.571374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:38.572060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:38.572509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:38.572964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:38.702625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:38.710910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-86fb77b0-81ff-4f74-b8e3-9de714b34ecd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151370 Aug 24 08:16:38.711484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 884/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:39.733065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:39.733734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:39.740154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:39.740633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:39.741094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:39.741777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:39.742226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:39.742645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:39.874136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:39.882433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-af647753-8301-448f-a3ea-5e9b0187a61c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153797 Aug 24 08:16:39.885906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 948/1832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:40.904012 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:40.904603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:40.910973 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:40.911450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:40.911886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:40.912565 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:40.913038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:40.913456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:41.046275 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:41.055008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eb8c5dba-08db-4dce-8c66-32adbf8e55e8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154539 Aug 24 08:16:41.055608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 885/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:40 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:42.076843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:42.077454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:42.083789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:42.084265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:42.084717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:42.085408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:42.085853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:42.086275 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:42.217737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:42.225905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c6a6f5a8-671f-4b34-aab2-c269cc9f9848 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153730 Aug 24 08:16:42.226464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 949/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:43.247129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:43.247747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:43.254268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:43.254744 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:43.255180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:43.255863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:43.256311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:43.256754 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:43.386733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:43.394885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ddedea87-fe6f-49de-8d65-469c483adedd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151533 Aug 24 08:16:43.395443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 886/1835] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:43 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:44.415628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:44.416308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:44.423628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:44.424108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:44.424574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:44.425288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:44.425737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:44.426157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:44.552730 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:44.561318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7b82e0b7-a1de-4036-8d54-18976ad235a6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149548 Aug 24 08:16:44.561885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 950/1836] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:44 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:45.583295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:45.583907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:45.591061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:45.591535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:45.591971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:45.592702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:45.593155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:45.593580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:45.721287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:45.729520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a7a4b73-d27d-4da1-881a-39bcb84c9b14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150062 Aug 24 08:16:45.730641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 887/1837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:46.752235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:46.752882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:46.759216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:46.759686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:46.760111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:46.760842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:46.761530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:46.761946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:46.893424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:46.901528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5728269d-e3bb-498c-a3f4-f99ab02eb9ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153041 Aug 24 08:16:46.902097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 951/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:47.922585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:47.923190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:47.929854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:47.930322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:47.930747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:47.931454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:47.931904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:47.932316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:48.062477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:48.070706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87b67ec2-f506-4ccf-a2ef-17901dde31a0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151879 Aug 24 08:16:48.071274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 888/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:16:49.094096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:49.094731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:49.101395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:49.101862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:49.102288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:49.102958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:49.103397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:49.103810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:49.232288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:49.240379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f1be23b-b1c1-4f08-a9a3-5d304a1a687c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150405 Aug 24 08:16:49.240968 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 952/1840] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:50.261868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:50.262430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:50.268775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:50.269246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:50.269673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:50.270349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:50.270789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:50.271200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:50.398560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:50.407224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-07c80e60-dd56-4d0c-a2c7-4ad1876833a3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149380 Aug 24 08:16:50.407780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 889/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:50 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:16:51.429509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:51.430120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:51.437362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:51.437831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:51.438257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:51.438957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:51.439401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:51.439810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:51.575068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:51.587771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3853a78-3142-4f2a-af3b-cb78f073bdb2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157830 Aug 24 08:16:51.587771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 953/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:51 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:52.607836 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:52.608450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:52.615094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:52.615569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:52.616002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:52.616720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:52.617164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:52.617579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:52.749784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:52.758212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f02c6e91-fc6a-4e22-a4fd-ce2bdf399627 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154843 Aug 24 08:16:52.758771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 890/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:52 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:53.780083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:53.780728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:53.787184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:53.787606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:53.788035 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:53.788774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:53.789234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:53.789650 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:53.915725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:53.924611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2df9da9d-7843-4efc-890f-1b753287210d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148408 Aug 24 08:16:53.925211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 954/1844] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:54.945944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:54.946470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:54.952765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:54.953236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:54.953660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:54.954370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:54.954806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:54.955219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:55.080685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:55.089000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-806f0cce-eaad-49a9-8c8b-9207e30665e3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.146926 Aug 24 08:16:55.089633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 891/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:56.110666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:56.111264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:56.117724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:56.118220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:56.118641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:56.119314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:56.120286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:56.121042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:56.251282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:56.259413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3c70bfe7-2c6b-4d20-a912-c327a62a56fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152676 Aug 24 08:16:56.259974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 955/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:56 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:57.281352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:57.281992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:57.284287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:57.288950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:57.289425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:57.289854 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:57.290533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:57.290979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:57.291397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:57.295399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=78 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:57.421946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:57.430433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b1bd29d-9cee-4df5-ae89-df91b04fc057 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152924 Aug 24 08:16:57.430997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 892/1847] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:58.451797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:58.452387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:58.454690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:58.459454 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:58.459924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:58.460350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:58.461064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:58.461503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:58.467496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:58.467496 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:58.592266 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:58.600695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d64927af-97e9-4f5d-b322-8d4dfc26eac6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152802 Aug 24 08:16:58.601258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 956/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:16:59.622914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:16:59.623512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:16:59.630011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:59.630486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:59.630913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:59.631592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:16:59.632036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:16:59.632450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:16:59.760830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:16:59.769143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-21b5b88d-78dc-4c44-bf7a-17ea558edbb4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150721 Aug 24 08:16:59.769711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 893/1849] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:16:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:00.790136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:00.790696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:00.797354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:00.797826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:00.798250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:00.798926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:00.799367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:00.799777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:00.932051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:00.940734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84aac149-f1f0-44c1-888f-53a369593252 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154477 Aug 24 08:17:00.941296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 957/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:01.961180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:01.961781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:01.969115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:01.969585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:01.970007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:01.970681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:01.971117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:01.971524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:02.102682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:02.111177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-85b2030d-dbf5-41c6-a6e3-dbe496f15786 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153797 Aug 24 08:17:02.111758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 894/1851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:03.133166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:03.133816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:03.141063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:03.141536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:03.141966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:03.142648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:03.143093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:03.143500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:03.161573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:03.161845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d (ip 10.222.0.26) !!! Aug 24 08:17:03.279944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:03.288150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-140209ca-8935-4243-9751-0ef22f022105 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158863 Aug 24 08:17:03.288729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 958/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:04.310259 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:04.310859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:04.317180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:04.317649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:04.318071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:04.318742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:04.319181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:04.319595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:04.449235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:04.457667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d0ef44cf-3277-4ba4-b859-e8d02f65a700 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151416 Aug 24 08:17:04.458229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 895/1853] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:04 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:05.478946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:05.479600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:05.486486 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:05.486957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:05.487383 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:05.488064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:05.488511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:05.488951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:05.618138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:05.626982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-422412b7-362b-4bdb-98ff-36328fabdad1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151914 Aug 24 08:17:05.627535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 959/1854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:06.649526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:06.650140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:06.657385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:06.657863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:06.658312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:06.658998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:06.659443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:06.659869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:06.787571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:06.796594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0e8e90ca-4121-4782-aef8-0cb722189c1c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150993 Aug 24 08:17:06.797179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 896/1855] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:07.818045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:07.818629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:07.825110 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:07.825779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:07.826203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:07.826918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:07.827361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:07.827778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:07.956283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:07.964411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-acf2118a-2c2a-4601-bcb3-06df797d3836 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150206 Aug 24 08:17:07.965003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 960/1856] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:08.985669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:08.986303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:08.992777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:08.993255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:08.993689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:08.994375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:08.994825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:08.995247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:09.126234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:09.134457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5251bf0b-f0ea-4c22-a2eb-aa06bf92e29f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152878 Aug 24 08:17:09.135032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 897/1857] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:10.156607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:10.157232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:10.163603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:10.164077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:10.164506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:10.165220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:10.165665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:10.166089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:10.292164 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:10.300447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7e5444b8-406d-4f86-8876-cb4f598c5927 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148510 Aug 24 08:17:10.301045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 961/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:10 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:11.322306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:11.322908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:11.329991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:11.330454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:11.330879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:11.331556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:11.331995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:11.332405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:11.461042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:11.470028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-181190ae-2a5d-43f4-99ff-a3fef130a9c9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151649 Aug 24 08:17:11.470589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 898/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:12.491288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:12.491885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:12.499204 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:12.499673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:12.500097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:12.500797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:12.501238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:12.501647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:12.631531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:12.640003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-27d0b295-2869-487e-9137-742dd2c162e7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152424 Aug 24 08:17:12.644150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 962/1860] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:13.003016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:13.003587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:17:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:13.660598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:13.661270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:13.667552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:13.668020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:13.668443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:13.669875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:13.670533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:13.670832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:13.802519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:13.811639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2367da39-c052-417c-8412-84ee3be7d3fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154850 Aug 24 08:17:13.812200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 899/1861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:14.832301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:14.832926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:14.839189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:14.839659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:14.840080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:14.840836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:14.841423 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:14.841839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:14.971302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:14.979553 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-26c59440-d631-429c-a97b-aa53c36dce18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150999 Aug 24 08:17:14.980119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 963/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:16.000755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:16.176404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:16.176404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:16.176404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:16.176404 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:16.176835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:16.176835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:16.176835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:16.177119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:16.177119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9e8f51e3-3cfe-435a-8471-5e40f071f4b0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.158895 Aug 24 08:17:16.177119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 900/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:17.177663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:17.178273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:17.185350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:17.185827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:17.186289 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:17.186964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:17.187403 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:17.187813 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:17.321749 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:17.329988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-219bd36b-2c03-4f56-909c-495d133ae4fa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156333 Aug 24 08:17:17.330550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 964/1864] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:17 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:18.351789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:18.352376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:18.359711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:18.360184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:18.360616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:18.361375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:18.361830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:18.362244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:18.510198 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:18.518808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a13429b2-09bd-4ef8-b3e8-82315c02c83f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.170887 Aug 24 08:17:18.519360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 901/1865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:18 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:19.540953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:19.541556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:19.548406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:19.548918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:19.549348 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:19.550026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:19.550469 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:19.550903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:19.683234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:19.692123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4fd638d2-0eec-45da-8298-b8bc966e93d1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154954 Aug 24 08:17:19.693002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 965/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:20.713686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:20.714295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:20.721418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:20.721887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:20.722316 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:20.722993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:20.723440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:20.723856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:20.853579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:20.855806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:20.856028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d (ip 10.222.0.26) !!! Aug 24 08:17:20.862995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-821e9ba7-6c37-4334-9458-160b65bf1c9c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153138 Aug 24 08:17:20.872108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 902/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:21.893111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:21.893725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:21.900155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:21.900633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:21.901090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:21.901776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:21.902224 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:21.902644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:22.032837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:22.041623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1cd14222-0222-449e-a8a9-6904d2475f76 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153210 Aug 24 08:17:22.042196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 966/1868] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:23.063995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:23.064628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:23.070975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:23.071444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:23.071868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:23.072539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:23.073001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:23.073416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:23.204135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:23.212561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d3805a11-57bc-4c66-b515-11459cda6045 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152956 Aug 24 08:17:23.213155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 903/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:23.221055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:23.221563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:24.235009 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:24.235734 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:24.241913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:24.242393 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:24.242846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:24.243546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:24.243992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:24.244447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:24.376038 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:24.384258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7829af7a-c588-4f94-a502-40828226736c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153892 Aug 24 08:17:24.384854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 967/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:24 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:25.405412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:25.406293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:25.412271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:25.412779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:25.413217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:25.413908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:25.414357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:25.414774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:25.545551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:25.554529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-55e03783-9bea-4b1c-ac53-409add37e46d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153047 Aug 24 08:17:25.555094 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 904/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:26.575279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:26.575883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:26.583024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:26.583490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:26.583911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:26.584583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:26.585045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:26.585457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:26.712903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:26.721538 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cce774c5-5b48-4cd0-a4f7-b1f3b31931d9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150101 Aug 24 08:17:26.722139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 968/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:27.743161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:27.743830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:27.746206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:27.751811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:27.752296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:27.752828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:27.753534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:27.754016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:27.754433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:27.758736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=78 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:27.886606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:27.895273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c2b2d8b-4d72-4bee-b13f-2f999a235cb1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156436 Aug 24 08:17:27.895831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 905/1873] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:28.917168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:28.917742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:28.919984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:28.925602 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:28.926077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:28.926513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:28.927192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:28.927738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:28.928157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:28.930959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:29.057829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:29.066070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76f2e2b4-d871-4357-a3b5-c6751e42250c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152782 Aug 24 08:17:29.066631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 969/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:28 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:30.087122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:30.087725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:30.094376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:30.094845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:30.095277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:30.095953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:30.096399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:30.096887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:30.226600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:30.236238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6af9cb61-9783-44f2-aa58-e1de8546a16f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153087 Aug 24 08:17:30.237030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 906/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:30 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:31.257466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:31.258073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:31.264565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:31.265067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:31.265493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:31.266331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:31.266755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:31.267174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:31.401587 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:31.410329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2e96fef1-2ce1-4132-8831-b0e900ca51da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156735 Aug 24 08:17:31.410894 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 970/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:32.432019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:32.432626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:32.440197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:32.440699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:32.441137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:32.441818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:32.442265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:32.442677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:32.575934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:32.584255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-48190a6d-91fb-44b8-8c51-7bad9650638f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.156392 Aug 24 08:17:32.584848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 907/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:33.605461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:33.606073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:33.612609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:33.613119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:33.613546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:33.614235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:33.614679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:33.615093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:33.755053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:33.763220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-180b561f-d61c-4834-ac24-6f32ad4e80da tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.161505 Aug 24 08:17:33.763776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 971/1878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:34.784384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:34.785156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:34.791526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:34.792006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:34.792443 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:34.793148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:34.793598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:34.794014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:34.920719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:34.929370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7bc7ad05-4d81-4cdc-a084-49c7dd0c34d5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149320 Aug 24 08:17:34.929942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 908/1879] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:34 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:35.951199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:35.951809 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:35.958227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:35.958700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:35.959127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:35.959837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:35.960286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:35.960722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:36.092280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:36.101296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-010c86e3-7f1d-4f29-ab23-c3d32ab48a2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153932 Aug 24 08:17:36.101855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 972/1880] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:37.122895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:37.123494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:37.130034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:37.130505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:37.130936 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:37.131615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:37.132061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:37.132476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:37.263274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:37.272244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-503ab34b-0cb7-42b1-bcac-345fb7fa2b88 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153213 Aug 24 08:17:37.272828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 909/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:37 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:17:38.293782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:38.294421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:38.300990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:38.301464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:38.301889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:38.302575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:38.303027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:38.303443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:38.430141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:38.438430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9348ff08-3c46-49b1-9026-eb6f90c38e00 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148450 Aug 24 08:17:38.438993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 973/1882] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:17:39.459406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:39.459992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:39.466432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:39.466911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:39.467340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:39.468021 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:39.468465 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:39.468907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:39.596867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:39.605058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d60116cd-4b4f-4829-9d2b-b1278a7bcb39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149463 Aug 24 08:17:39.605619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 910/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:40.627662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:40.628190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:40.634693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:40.635171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:40.635601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:40.636288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:40.636769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:40.637190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:40.764167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:40.772500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-303a2272-7647-41aa-9ce3-9cc807d7678d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149476 Aug 24 08:17:40.773095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 974/1884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:40 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:41.793739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:41.794272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:41.800978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:41.801448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:41.801874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:41.802545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:41.803173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:41.803393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:41.932674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:41.941497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36f08f37-37da-44b4-b98e-742dd475a567 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151699 Aug 24 08:17:41.942055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 911/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:41 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:42.963024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:42.963631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:42.971029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:42.971502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:42.971964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:42.972666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:42.973111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:42.973527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:43.104703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:43.113558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2c0d228f-6154-40c5-b20b-7127e4fa6ccd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154389 Aug 24 08:17:43.114127 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 975/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:44.135796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:44.142619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:44.144408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:44.144914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:44.145341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:44.146033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:44.146474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:44.146919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:44.284130 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:44.292317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1abb88ac-94dd-4f77-9f16-5f22509da44e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.161025 Aug 24 08:17:44.292915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 912/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:44 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:45.314516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:45.315131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:45.321493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:45.321966 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:45.322394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:45.323072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:45.323517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:45.323933 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:45.449225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:45.457414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3ced7c99-100a-40aa-8c8a-3f7afd8cbcb0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.147366 Aug 24 08:17:45.457973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 976/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:46.481141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:46.481747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:46.488240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:46.488740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:46.489172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:46.489855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:46.490300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:46.490718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:46.618179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:46.627099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56f5c955-a5e2-4384-9349-adf344275d18 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149792 Aug 24 08:17:46.627662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 913/1889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:47.648930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:47.649474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:47.655999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:47.657123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:47.657552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:47.658225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:47.658665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:47.659076 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:48.047990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:48.056495 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5e717aed-2031-4c2d-8087-ba4821d28e04 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.411558 Aug 24 08:17:48.057095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 977/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:49.079157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:49.079784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:49.086099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:49.086583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:49.087010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:49.087687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:49.088128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:49.088539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:49.218174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:49.226985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-241c8d51-2dae-45fb-bdd7-6ac4f489ce08 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151725 Aug 24 08:17:49.227550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 914/1891] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:17:50.248760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:50.249397 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:50.256312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:50.256828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:50.257257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:50.257940 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:50.258385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:50.258805 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:50.387231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:50.395711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5965b57a-1cec-4780-b2e0-01376991d749 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150825 Aug 24 08:17:50.396278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 978/1892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:50 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:51.417176 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:51.417788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:51.424945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:51.425421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:51.425856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:51.426535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:51.426984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:51.427408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:51.559960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:51.567748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4df25879-0b4a-4ed0-99f7-8080c38181de tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154437 Aug 24 08:17:51.568311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 915/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:51 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:52.589139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:52.589746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:52.596535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:52.597057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:52.597485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:52.598174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:52.598644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:52.599065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:52.732082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:52.741028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f11d0954-1e0f-4e59-b3f1-e408cea2e4c1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155781 Aug 24 08:17:52.741594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 979/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:52 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:53.762840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:53.763445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:53.770566 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:53.771042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:53.771471 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:53.772156 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:53.772605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:53.773050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:53.902010 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:53.910192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f2dcaf4-3ca6-4f0b-8e98-98a11d214dde tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151422 Aug 24 08:17:53.910761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 916/1895] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:54.931457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:54.932085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:54.938055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:54.938523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:54.938947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:54.939726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:54.940168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:54.940580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:55.067961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:55.076070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e504271d-a4a5-4f1d-8570-0c302d136f4b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148869 Aug 24 08:17:55.076621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 980/1896] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:56.097693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:56.098299 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:56.104676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:56.105155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:56.105584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:56.106263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:56.106707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:56.107125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:56.233832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:56.242478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-324ff29d-6ad1-4479-bd82-0ccb0ffc5702 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148710 Aug 24 08:17:56.243033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 917/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:56 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:17:57.263610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:57.264241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:57.270838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:57.271305 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:57.271726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:57.272400 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:57.272862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:57.273273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:57.405477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:57.413815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9bfed077-d071-42f2-8c84-ae21f9c9fda1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154037 Aug 24 08:17:57.414381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 981/1898] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:58.434174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:58.434785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:58.437245 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:58.442625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:58.443103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:58.443535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:58.444219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:58.444718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:58.445143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:58.449101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=78 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:58.575835 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:58.584352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-22031dc2-7035-4557-b78c-a88df6b1a705 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154061 Aug 24 08:17:58.584948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 918/1899] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:17:59.606720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:17:59.607326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:17:59.609596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:59.614783 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:59.615252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:59.615674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:59.616345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:17:59.616819 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:17:59.617278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:17:59.621079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=78 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:59.747197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:17:59.756134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-41a82306-13c3-4d11-bdcb-c6565b546ba7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.153307 Aug 24 08:17:59.756726 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 982/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:17:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:00.777632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:00.778240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:00.785062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:00.785480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:00.785972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:00.786646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:00.787089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:00.787502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:00.916986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:00.925694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8a0125c7-8f7d-46ee-ae45-1861032bfd1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151979 Aug 24 08:18:00.926263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 919/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:01.946847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:01.947458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:01.953932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:01.955276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:01.955755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:01.956480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:01.956951 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:01.957369 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:02.104008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:02.110648 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-be36a6af-ee58-4934-b3f4-7c37344a71ea tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.167612 Aug 24 08:18:02.111219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 983/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:03.131713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:03.132406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:03.138802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:03.139272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:03.139700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:03.140382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:03.140858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:03.141277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:03.268343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:03.276574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca9b3f88-5e3c-4c6b-bc8d-c54e6cae095a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148638 Aug 24 08:18:03.277163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 920/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:18:04.297264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:04.298528 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:04.305251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:04.305724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:04.306155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:04.306837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:04.307283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:04.307698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:04.440698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:04.448778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6ec0a5fb-55ca-486e-aeac-b9c9a234d494 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.155336 Aug 24 08:18:04.449341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 984/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:04 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:05.470546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:05.471163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:05.477723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:05.478196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:05.478620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:05.479294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:05.479740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:05.480151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:05.611239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:05.619394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b3c6660-890a-4922-a9dc-f224b0aa5f3f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152957 Aug 24 08:18:05.619955 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 921/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:06.640736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:06.641351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:06.648446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:06.648953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:06.649387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:06.650070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:06.650517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:06.650936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:06.778919 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:06.787126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb37442b-9a75-47e4-b872-1e4a4ec030f5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150332 Aug 24 08:18:06.787697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 985/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:07.809334 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:07.809944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:07.816920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:07.817393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:07.817828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:07.818514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:07.818957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:07.819371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:07.945687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:07.953730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee4dd9c3-8538-4e05-9b3f-0afd05fdae48 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148279 Aug 24 08:18:07.955020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 922/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:08.975116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:08.975720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:08.982103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:08.982575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:08.982996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:08.983668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:08.984113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:08.984527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:09.117924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:09.126780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b7e4e11-0d72-4162-98a3-5c5f4339e6dd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.154854 Aug 24 08:18:09.127357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 986/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:10.148231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:10.148897 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:10.155274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:10.155753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:10.156181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:10.156900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:10.158044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:10.158462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:10.285306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:10.293353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-82bb7763-3ee0-4f38-8e82-4cd861275bec tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.148959 Aug 24 08:18:10.293917 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 923/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:10 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:11.316072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:11.316702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:11.323046 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:11.323516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:11.323944 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:11.324623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:11.325087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:11.325498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:11.455384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:11.463673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-47b5a323-7195-47fb-8afb-a0b5468a096e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152309 Aug 24 08:18:11.464240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 987/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:12.485070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:12.485886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:12.492235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:12.492733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:12.493166 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:12.493848 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:12.494294 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:12.494711 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:12.630931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:12.639187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f63f6c2f-8efa-463e-9d88-1c2af0521d0e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157972 Aug 24 08:18:12.639747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 924/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:13.660590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:13.661222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:13.667533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:13.668010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:13.668444 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:13.669160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:13.669611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:13.670030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:13.797320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:13.806378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-337f0060-00b7-4523-839b-d0813bb594bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.149667 Aug 24 08:18:13.806948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 988/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:14.828109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:14.828878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:14.835467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:14.835946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:14.836364 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:14.837063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:14.837503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:14.837913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:14.966090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:14.974509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-73a4bac3-b758-40a0-9b9c-cd3f2c5d7e8e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150230 Aug 24 08:18:14.975067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 925/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:15.995953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:15.996562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:16.003596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:16.004074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:16.004506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:16.005216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:16.005665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:16.006085 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:16.134678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:16.142868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e1bd794e-865d-45c4-a454-e0444c1ef8d2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150710 Aug 24 08:18:16.143432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 989/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:17.163998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:17.164602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:17.171048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:17.171516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:17.171964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:17.173327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:17.173950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:17.174365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:17.304814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:17.312901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c43ebe4-2236-4573-ab15-2e35ad37bd0d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152770 Aug 24 08:18:17.313759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 926/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:17 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:18.334471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:18.335077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:18.341599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:18.342084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:18.342512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:18.343206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:18.343640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:18.344055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:18.478511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:18.487984 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2507a8da-a159-4a3c-be09-0fceb533d89a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.157372 Aug 24 08:18:18.488563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 990/1916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:18 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:19.510456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:19.511075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:19.517712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:19.518192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:19.518624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:19.519310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:19.519763 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:19.520179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:19.649142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:19.657539 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-daf4ebd6-07b7-4529-ad37-43cc7bdce79b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.150807 Aug 24 08:18:19.658110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 927/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:20.679158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:20.679767 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:20.686241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:20.686719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:20.687149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:20.687831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:20.688838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:20.689258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:20.818979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:20.827060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6aaf3842-86c0-4127-b95b-b4a0447bcf92 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.152087 Aug 24 08:18:20.827627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 991/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:21.848930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:21.849543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:21.855967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:21.856439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:21.856905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:21.857585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:21.858029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:21.858446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:21.988435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:21.996659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-02981d12-b844-485c-8d88-a5f9b0af68c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.151657 Aug 24 08:18:21.997230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 928/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:22.020195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:22.020782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:22.027132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:22.027599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:22.028023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:22.028731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:22.029174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:22.029586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:22.043620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 HTTP/1.1 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:18:22.045259 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.054015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': 'e0c73c11-2b2f-402b-854b-a59b40417d62'} Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:18:22.056072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.059398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.061131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:18:22.061131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0b3db1c5-8b0c-4d45-a051-77fca9f9003a tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 404 len: 111 microversion: 2.1 time: 0.030620 Aug 24 08:18:22.061131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 992/1920] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:18:22 2022] DELETE /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:18:22.066406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:22.067091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] [instance: e0c73c11-2b2f-402b-854b-a59b40417d62] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:22.073251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:22.073722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:22.074151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:22.074827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:22.075273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:22.075687 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:22.089660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] HTTP exception thrown: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Request method failure captured: Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 HTTP/1.1 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdiajPY_MSDDkAlQRIfoyZZtiR7RD9x89pLiPxMpuyA2lw-lkSfNKq-2qFvWV8HUG6PsadaDhKtHqxadSqq0CWpjK-cutyJJT0b-g-xRS3Lcrk5eWC1rvhrEGfDeH0BVZrncBPVKNhXTAC0xn0ShVh1WEa8NCxMGCUMuBM6DzEOZ04o Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:18:22.091337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee7ef4f035fd402fb7e21a21c40e7c49"}]}] Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: ee7ef4f035fd402fb7e21a21c40e7c49 Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1732323315 Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: aee01beeba5b48c3b6c25489743de40e Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-1732323315-project Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.093175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': 'e0c73c11-2b2f-402b-854b-a59b40417d62'} Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:18:22.099230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. Aug 24 08:18:22.101034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:18:22.102522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] Returning 404 to user: Instance e0c73c11-2b2f-402b-854b-a59b40417d62 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:18:22.102522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b7b6195-2daa-41e2-b548-187b6c63ac30 tempest-AttachVolumeNegativeTest-1732323315 tempest-AttachVolumeNegativeTest-1732323315-project] 10.222.0.26 "GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62" status: 404 len: 111 microversion: 2.1 time: 0.031091 Aug 24 08:18:22.102522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 929/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:22 2022] GET /compute/v2.1/servers/e0c73c11-2b2f-402b-854b-a59b40417d62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:18:23.019226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:23.019826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:23.026101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:23.026698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:23.026982 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:23.027661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:23.028099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:23.028506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:23.167099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:23.174694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ff06ec32-b2d6-42d1-ba2d-ac7e4fdf0c24 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.159994 Aug 24 08:18:23.175264 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 993/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:24.197990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:24.199511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:24.211669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:24.212181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:24.213101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:24.213819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:24.215356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:24.215798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:24.441983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:24.465091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b6337ef6-dccd-4ebf-be94-f805428c8a89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1560 microversion: 2.1 time: 0.257829 Aug 24 08:18:24.466476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 930/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:24 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1560 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:24.816132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810c41f4-f7ab-43b6-bbdb-81d52de49f0d", "name": "network-vif-deleted", "tag": "8ceae910-04d6-4271-b981-57b6f62898ca"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:18:24.826764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:24.827226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:24.827643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:24.840388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] Creating event network-vif-deleted:8ceae910-04d6-4271-b981-57b6f62898ca for instance 810c41f4-f7ab-43b6-bbdb-81d52de49f0d on hv-cinder-85427 Aug 24 08:18:24.847720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-28685385-4923-4ef6-b7ee-d09c1e36f27a req-dc2186f5-98ea-4edb-80d7-4c399552cb65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172053 Aug 24 08:18:24.848626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 994/1924] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:18:25.474611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:25.475338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:25.483137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:25.484008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:25.484606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:25.486096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:25.486721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:25.487144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:25.579528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:25.590041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a5c534f-0786-4406-8b61-a8dab568b3ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.119879 Aug 24 08:18:25.590962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 931/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:26.613060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:26.613769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:26.619927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:26.620395 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:26.620860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:26.621545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:26.621975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:26.622385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:26.700590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:26.709020 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e269d89a-0710-4adc-9337-18e59c0027ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.101601 Aug 24 08:18:26.709665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 995/1926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:27.730529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:27.731174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:27.738497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:27.740014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:27.740014 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:27.740290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:27.740513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:27.740959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:27.805978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:27.814548 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-297bd93b-9c4d-4ead-a0a3-2ce38e414ce8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087863 Aug 24 08:18:27.815117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 932/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:28.835818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:28.836421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:28.843080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:28.843589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:28.844626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:28.851468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:28.851468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:28.851468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:28.910436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:28.918551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ac0df0cb-87c7-4c0c-bf2b-b0d1383e11ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086724 Aug 24 08:18:28.919113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 996/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:28 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:29.945330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:29.946117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:29.948454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=30 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:29.953109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:29.954372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:29.955217 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:29.955913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:29.956362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:29.956867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:29.960893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=86 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:30.028133 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:30.037053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fb384806-3f18-4db9-a893-43e40e55626e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.095398 Aug 24 08:18:30.037615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 933/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:29 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:31.059089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:31.059698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:31.062200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=30 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:31.075406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:31.075406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:31.075406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:31.075406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:31.075847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:31.075847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:31.075847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=82 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:31.141455 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:31.149880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6b2b36bc-0e21-408a-b1ea-3d167f415f6b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.094698 Aug 24 08:18:31.150453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 997/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:32.171773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:32.173011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:32.179766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:32.180232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:32.180676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:32.181367 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:32.181817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:32.182236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:32.249496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:32.258265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1f00c1b8-a30a-47a4-ae82-b64aa1e97839 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.090551 Aug 24 08:18:32.261995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 934/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:33.279697 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:33.280313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:33.287693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:33.288172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:33.288603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:33.289507 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:33.290126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:33.290737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:33.363430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:33.372075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-108965de-a339-4294-bd06-b0b775585002 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.096514 Aug 24 08:18:33.373109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 998/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:34.393704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:34.394314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:34.400667 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:34.401140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:34.401573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:34.402251 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:34.402694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:34.403109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:34.465426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:34.473842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eb104049-d1df-4953-a602-9ee4d065a368 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084716 Aug 24 08:18:34.476448 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 935/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:34 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:35.495327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:35.495948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:35.503426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:35.503892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:35.504313 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:35.505016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:35.505460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:35.505872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:35.569427 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:35.577459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe388318-e850-4cd1-b56f-27a33b37cf47 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086032 Aug 24 08:18:35.579193 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 999/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:36.598916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:36.599460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:36.606163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:36.606641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:36.607075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:36.607759 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:36.608210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:36.608634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:36.669865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:36.678512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25a7c0b6-56a7-4237-89ac-8f56fef16092 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083285 Aug 24 08:18:36.679082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 936/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:36 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:37.700094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:37.700818 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:37.707607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:37.708074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:37.708497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:37.709195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:37.709635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:37.710052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:37.772431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:37.780834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d73347e0-4324-4ec6-9c2c-d07cf0859ba4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084642 Aug 24 08:18:37.787149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1000/1936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:37 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:38.804041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:38.804604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:38.811152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:38.816358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:38.816358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:38.816358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:38.816358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:38.816787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:38.875837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:38.890037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc5d4f0b-ccda-49db-9ed6-4a26be23655f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.090167 Aug 24 08:18:38.893175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 937/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:39.921078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:39.921747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:39.929121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:39.929598 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:39.930022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:39.930703 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:39.931146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:39.931563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:39.992238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:40.001011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-76510b27-d8c0-4de2-9287-c168af63d3ac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083060 Aug 24 08:18:40.001737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1001/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:41.022700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:41.023341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:41.029742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:41.030218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:41.030646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:41.031555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:41.032004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:41.032427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:41.100831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:41.109270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b318a6e-8ea3-4cd4-8cf4-2ee062d87bdd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.090457 Aug 24 08:18:41.110173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 938/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:41 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:42.130523 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:42.131169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:42.137578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:42.138058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:42.138493 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:42.139185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:42.139635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:42.140053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:42.204412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:42.213065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-afcaeb9e-b49e-4c6b-bd7a-88181c6b86bd tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087051 Aug 24 08:18:42.213635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1002/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:43.234325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:43.234930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:43.242055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:43.242526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:43.242954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:43.243629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:43.244073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:43.244486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:43.305235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:43.313327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-917bbf23-0ecb-4fcc-ba53-8199475558a1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082830 Aug 24 08:18:43.313893 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 939/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:43 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:44.334476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:44.335051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:44.341324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:44.341789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:44.342217 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:44.342888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:44.343324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:44.343733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:44.405365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:44.413664 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ae2593ef-fd3e-4bab-beb7-ee7a995402c7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083136 Aug 24 08:18:44.414229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1003/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:44 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:45.435277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:45.435963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:45.443374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:45.443841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:45.444267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:45.444967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:45.445407 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:45.445825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:45.506730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:45.514857 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39942b76-c57e-43e2-b247-970ef2d4a97b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083550 Aug 24 08:18:45.515418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 940/1943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:46.536474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:46.537121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:46.543672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:46.544138 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:46.544570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:46.545279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:46.545718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:46.546128 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:46.611346 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:46.619607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2c9e8bb5-0ece-429b-ae78-d4215036a0b9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087186 Aug 24 08:18:46.620215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1004/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:47.640803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:47.641396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:47.648155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:47.648621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:47.649075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:47.649823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:47.650262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:47.650671 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:47.712622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:47.721796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0906606f-ac00-43c5-bd9f-f862316cf731 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084867 Aug 24 08:18:47.722359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 941/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:48.438079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:18:48.438297 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:18:48.742475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:48.743084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:48.749663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:48.750141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:48.750572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:48.751963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:48.752480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:48.752922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:48.814554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:48.822684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-849f1446-b576-4ee5-b140-f9492f167d78 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084157 Aug 24 08:18:48.823243 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1005/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:48 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:49.844281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:49.845554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:49.852148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:49.852626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:49.853118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:49.853802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:49.854255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:49.854675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:49.918839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:49.927488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00439d0f-b95e-44bd-ab72-8b33c14e2c25 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087120 Aug 24 08:18:49.928302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 942/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:50.949987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:50.950601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:50.958268 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:50.958759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:50.959185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:50.959864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:50.960304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:50.960743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:51.028337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:51.036824 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9719d22-75e0-43a1-a03e-2865d8549ed3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.090779 Aug 24 08:18:51.037386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1006/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:50 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:52.058296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:52.058912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:52.066119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:52.066596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:52.067060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:52.067710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:52.068153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:52.068571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:52.129874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:52.137945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d09f6e8-7d1a-4e90-97ff-0aa4b0b71320 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083493 Aug 24 08:18:52.138508 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 943/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:52 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:53.158913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:53.159530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:53.166019 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:53.166498 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:53.166932 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:53.167614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:53.168071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:53.168489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:53.229371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:53.238327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-77567a2a-64ee-4cc8-96e2-566526bb8e03 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083388 Aug 24 08:18:53.238898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1007/1950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:54.259457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:54.260057 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:54.265961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:54.266429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:54.267474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:54.268502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:54.269001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:54.269433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:54.333703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:54.342056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-33e11eb8-4ac2-429a-aec0-1db754c29cc5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086552 Aug 24 08:18:54.342624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 944/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:55.363778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:55.364453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:55.370599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:55.371075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:55.371503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:55.372186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:55.372633 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:55.373071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:55.445624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:55.453879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3051fc9e-5c74-4fe3-9013-894a4100b8f7 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.094455 Aug 24 08:18:55.455185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1008/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:55 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:56.475397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:56.476009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:56.482385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:56.482856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:56.483287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:56.483967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:56.484411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:56.484856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:56.548952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:56.557647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-916016b9-9a90-488f-a4c5-9ae8b849b629 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086068 Aug 24 08:18:56.558205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 945/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:56 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:18:57.579074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:57.580388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:57.586751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:57.587228 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:57.587666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:57.588356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:57.588839 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:57.589257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:57.651606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:57.659868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8eb6b1a1-fa1e-41ac-8de4-41d3cb54adb3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084804 Aug 24 08:18:57.662097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1009/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:58.681042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:58.681646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:58.687953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:58.688418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:58.688902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:58.689572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:58.690013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:58.690421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:58.753611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:58.761924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-38e43a0d-dd31-4ac3-a778-e061efa2fece tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084990 Aug 24 08:18:58.762490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 946/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:18:59.783443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:18:59.783978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:18:59.790537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:59.791011 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:59.791432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:59.792131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:18:59.792570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:18:59.793006 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:18:59.857740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:18:59.865963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-638e20d5-d9ab-49b7-b4c5-913771c731ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086635 Aug 24 08:18:59.866518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1010/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:18:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:00.887188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:00.887838 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:00.890201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:00.895327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:00.895796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:00.896219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:00.896914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:00.897354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:00.897762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:00.959326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:00.967282 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab97dfdd-f549-46b6-8dc4-b88c4a29531f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083858 Aug 24 08:19:00.968063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 947/1957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:01.989053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:01.989695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:01.992130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=28 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:01.996901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:02.003687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:02.003687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:02.003687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:02.003687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:02.004129 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:02.063460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:02.072017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-81547abc-aa7d-4f1b-9b1b-eb80b43b2a82 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087496 Aug 24 08:19:02.072573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1011/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:03.092652 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:03.093286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:03.099646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:03.100138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:03.100551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:03.101255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:03.101700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:03.102116 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:03.105985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=90 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:03.162309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:03.170599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4e71a42e-bf9b-4259-8082-8eca68c3af86 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.081770 Aug 24 08:19:03.171163 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 948/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:04.192476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:04.193105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:04.199788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:04.200258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:04.200719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:04.201388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:04.201832 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:04.202328 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:04.206181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=90 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:04.264841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:04.273242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-67b9b9e3-1679-46ba-831d-92131822e849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085366 Aug 24 08:19:04.273804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1012/1960] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:04 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:05.294736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:05.295343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:05.302750 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:05.303226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:05.303654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:05.304331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:05.304809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:05.305222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:05.366834 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:05.375132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c24defc-3770-43d4-9ec4-cc8c1fd9e9b1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084264 Aug 24 08:19:05.375698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 949/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:06.397511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:06.398151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:06.404853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:06.405326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:06.405752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:06.406428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:06.406867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:06.407286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:06.470066 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:06.479320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c4ea8276-1d5a-4f09-b4b5-54850632060a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086161 Aug 24 08:19:06.479893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1013/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:07.501290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:07.501906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:07.509125 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:07.509609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:07.510044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:07.510738 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:07.511187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:07.511605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:07.578280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:07.586533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-64cf10e0-8a29-4a15-aef0-ab7ed934e5b4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.089142 Aug 24 08:19:07.593576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 950/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:08.611388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:08.612075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:08.618691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:08.619161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:08.619584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:08.620263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:08.620722 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:08.621142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:08.685567 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:08.694440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-79861edb-16c5-41c5-ac77-4dfc970313a4 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086884 Aug 24 08:19:08.694996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1014/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:09.715195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:09.715803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:09.722863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:09.723350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:09.723773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:09.724570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:09.725048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:09.725464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:09.786063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:09.794439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2dde40fe-49d4-43a2-90ff-ccb6c9e60ad9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083087 Aug 24 08:19:09.795042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 951/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:09 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:10.815223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:10.816411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:10.823027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:10.823494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:10.823917 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:10.824594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:10.825058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:10.825467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:10.886923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:10.895937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-967f3d87-6a90-46c0-9c29-142ab12b439d tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084517 Aug 24 08:19:10.896502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1015/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:10 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:11.916511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:11.917203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:11.923651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:11.924126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:11.924558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:11.925383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:11.925832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:11.926250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:11.988792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:11.997082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-394aef1c-53d9-4dc2-8b6e-c2e2543134ba tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084349 Aug 24 08:19:11.997654 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 952/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:13.017575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:13.018223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:13.024776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:13.025252 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:13.025682 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:13.026364 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:13.026812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:13.027230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:13.088325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:13.096477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c91bb885-dfbd-4b3f-8555-e6ae13253638 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082768 Aug 24 08:19:13.097673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1016/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:13 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:14.118587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:14.132532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:14.132532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:14.132532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:14.132532 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:14.133024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:14.133024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:14.133024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:14.189665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:14.198691 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a0564f48-a950-469f-9b9e-e86292365f59 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084350 Aug 24 08:19:14.199250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 953/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:15.219053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:15.219691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:15.226263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:15.229531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:15.229531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:15.229531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:15.229531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:15.229946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:15.290487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:15.298780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-82e6a7de-402f-498c-bbef-db491e59497f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083619 Aug 24 08:19:15.299446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1017/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:16.322281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:16.322870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:16.329333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:16.329752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:16.330177 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:16.330849 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:16.331325 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:16.331737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:16.395788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:16.404123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e3eead45-fc72-4f8b-b2b0-7f86fa8918bf tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085702 Aug 24 08:19:16.404712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 954/1971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:16 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:17.426606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:17.427150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:17.433849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:17.434320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:17.434751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:17.435433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:17.435879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:17.436297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:17.505638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:17.513803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-78d86062-6bd6-401c-a7e2-bf644738e9fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.091652 Aug 24 08:19:17.528707 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1018/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:17 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:18.547093 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:18.547952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:18.556820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:18.557300 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:18.557727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:18.558415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:18.558851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:18.559309 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:18.624966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:18.633841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ecfdd3f-4ac8-4c26-9f1d-d8ae0ddf92d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.090680 Aug 24 08:19:18.634412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 955/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:18 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:19.655024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:19.655631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:19.662297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:19.662771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:19.663200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:19.663880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:19.664325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:19.664781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:19.727344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:19.735513 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6f95f207-5e1c-4593-be1d-aec77ca0615a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084372 Aug 24 08:19:19.736074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1019/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:20.757591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:20.758199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:20.764895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:20.765362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:20.765784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:20.766459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:20.766926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:20.767336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:20.828055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:20.837199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f5cf92c-49ba-450c-ad61-71784a346727 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084022 Aug 24 08:19:20.837757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 956/1975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:21.858057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:21.858661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:21.865225 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:21.865698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:21.866125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:21.866802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:21.867247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:21.867662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:21.928457 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:21.936551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0f29d901-cc56-4257-a4be-6ea4b39546c3 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082311 Aug 24 08:19:21.937142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1020/1976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:23.145639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:23.146250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:23.152087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:23.152555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:23.153016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:23.153697 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:23.154174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:23.154585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:23.215233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:23.223631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7b5ca56f-b728-4a13-ab73-910857964ad2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.270941 Aug 24 08:19:23.224185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 957/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:22 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:24.244290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:24.244887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:24.251021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:24.254041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:24.254041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:24.254041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:24.254041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:24.254779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:24.412332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:24.420516 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f6eb5535-1d72-4a81-8e59-735c19b53d1a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.180170 Aug 24 08:19:24.421108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1021/1978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:24 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:25.442627 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:25.443492 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:25.450008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:25.450504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:25.450926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:25.451594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:25.452033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:25.452441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:25.572993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:25.581273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b33675ed-6a68-465b-97bc-49432d520ffe tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.143561 Aug 24 08:19:25.582042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 958/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:25 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:26.602335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:26.602942 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:26.609411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:26.609882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:26.610314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:26.610993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:26.611437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:26.611853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:26.676802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:26.685209 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5a3054d1-aac2-4d1a-bfaa-fc4816457d50 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086684 Aug 24 08:19:26.685772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1022/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:26 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:27.707870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:27.708509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:27.715039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:27.715505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:27.715930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:27.716604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:27.717069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:27.717483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:27.778172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:27.787026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5b047a39-f34e-44dc-a9b5-54d41c9f8831 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083766 Aug 24 08:19:27.787520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 959/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:27 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:28.807898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:28.808506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:28.814998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:28.815476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:28.815908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:28.816594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:28.817067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:28.817485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:28.881021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:28.890458 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2a9507e2-1544-4474-b6e5-dc875d7c7e39 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086463 Aug 24 08:19:28.891002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1023/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:28 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:29.910761 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:29.911362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:29.917778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:29.918248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:29.918675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:29.919349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:29.919816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:29.920232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:29.981735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:29.990642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa276d54-9220-46db-ac35-fc0f133d9ad5 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083832 Aug 24 08:19:29.991218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 960/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:29 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:31.012591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:31.013385 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:31.021771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:31.022299 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:31.022880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:31.023572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:31.024018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:31.024439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:31.101113 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:31.109437 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f1c21721-04f4-4991-998d-5de3d4ffcea2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.101118 Aug 24 08:19:31.109998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1024/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:31 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:32.130472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:32.131080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:32.133378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:32.138089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:32.138556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:32.138982 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:32.139657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:32.140101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:32.140528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:32.203721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:32.216159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5dc52bd1-0f33-43bf-85b6-9a681dd76019 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.089532 Aug 24 08:19:32.216999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 961/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:32 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:33.237692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:33.238871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:33.245413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:33.245884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:33.246326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:33.247013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:33.247453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:33.247866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:33.312438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:33.320995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f5ebca4c-0c99-483d-982d-4c2b2f04c9ce tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087047 Aug 24 08:19:33.321570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1025/1986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:33 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:34.341651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:34.342262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:34.349724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:34.350199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:34.350633 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:34.351322 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:34.351767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:34.352182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:34.356215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=84 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:34.419036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:34.427796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d7b92b7-2900-4901-bbcc-1a3f2c017f33 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.089996 Aug 24 08:19:34.428372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 962/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:34 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:35.448276 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:35.448973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:35.451375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=30 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:35.456012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:35.456479 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:35.457060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:35.461509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:35.461509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:35.461509 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:35.524316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:35.532943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b4a863be-6770-46c2-bfd5-ab13f18750aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.088178 Aug 24 08:19:35.533548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1026/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:35 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:36.560709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:36.561315 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:36.568464 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:36.568964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:36.569393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:36.570064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:36.570500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:36.570910 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:36.633129 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:36.641284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4cb78649-5f34-4fc5-86bb-9eabd39c39fb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084521 Aug 24 08:19:36.641850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 963/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:36 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:37.662511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:37.663107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:37.669522 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:37.669991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:37.670418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:37.671108 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:37.671547 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:37.672016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:37.676470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=90 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:37.733321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:37.742052 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-17201a39-890d-4ddb-a746-a287d31008fc tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083557 Aug 24 08:19:37.742608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1027/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:37 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:38.763306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:38.763915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:38.770938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:38.771416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:38.771870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:38.772536 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:38.773015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:38.773436 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:38.834772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:38.843047 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-982d5fa8-9a5d-4042-85fb-070480136fac tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083479 Aug 24 08:19:38.850096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 964/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:38 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:39.869721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:39.870361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:39.876771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:39.877246 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:39.877679 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:39.878367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:39.878808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:39.879222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:39.941477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:39.950517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2c8ff73e-969d-469c-942f-4221fe6f426b tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084543 Aug 24 08:19:39.951090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1028/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:39 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:40.972639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:40.973271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:40.979813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:40.980285 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:40.980746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:40.981428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:40.981872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:40.982290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:41.044603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:41.053260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-491920b1-6562-44b7-9154-7945645cc424 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084429 Aug 24 08:19:41.053821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 965/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:40 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:42.075093 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:42.075693 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:42.082126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:42.082594 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:42.083170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:42.084131 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:42.084575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:42.085022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:42.145557 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:42.153775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f3aa2b0d-7c1f-482e-a1cf-40ea6e64fba1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082472 Aug 24 08:19:42.154335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1029/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:42 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:43.175187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:43.175719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:43.183008 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:43.183478 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:43.183907 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:43.184705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:43.185182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:43.185595 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:43.251795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:43.260256 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6573eb4-0b6d-4156-b24d-d264e94613ab tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.088985 Aug 24 08:19:43.260860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 966/1995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:43 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:19:44.283946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:44.284480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:44.291756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:44.292223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:44.292663 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:44.293344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:44.293782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:44.294190 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:44.358685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:44.367061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0c498b20-4c6e-4eb9-a7eb-927b6dd39d43 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087059 Aug 24 08:19:44.367617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1030/1996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:44 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:45.387255 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:45.387866 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:45.394395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:45.394869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:45.395949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:45.396688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:45.397140 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:45.397561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:45.457640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:45.466771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e7eb5f9-ca6f-4b44-898f-6e6aab0d8b89 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083366 Aug 24 08:19:45.467342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 967/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:45 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:46.487057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:46.487667 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:46.494297 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:46.494800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:46.495233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:46.495913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:46.496358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:46.496812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:46.560536 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:46.568900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3ac23c5e-596c-4c95-9a19-6c3761e0a9c2 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085677 Aug 24 08:19:46.569467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1031/1998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:46 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:47.590194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:47.590833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:47.597306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:47.597787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:47.598219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:47.598911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:47.599500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:47.599913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:47.660760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:47.669132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b9a6301-cb5c-4fe4-86a0-834b584df591 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082762 Aug 24 08:19:47.669701 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 968/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:47 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:48.690114 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:48.690641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:48.697590 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:48.698059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:48.698481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:48.699154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:48.699586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:48.699993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:48.764067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:48.772227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-418305fb-c65b-4592-8d49-3bae09243630 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085952 Aug 24 08:19:48.772812 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1032/2000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:48 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:49.793264 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:49.793783 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:49.800144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:49.800612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:49.801065 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:49.801736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:49.802694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:49.803115 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:49.863394 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:49.871769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b0fe1331-2d1e-4976-a4e6-c77f8545bc30 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082386 Aug 24 08:19:49.872329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 969/2001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:49 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:50.893168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:50.893782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:50.900794 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:50.901270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:50.901699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:50.902379 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:50.902886 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:50.903325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:50.963596 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:50.971747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5191fd69-d3c6-4a3c-b889-17dd401ecbdb tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082403 Aug 24 08:19:50.972311 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1033/2002] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:50 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:51.994044 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:51.997062 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:52.001106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:52.001582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:52.002013 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:52.002694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:52.003141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:52.003560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:52.068571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:52.076884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5587263-5e41-4c94-a046-9a040ca26416 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087420 Aug 24 08:19:52.077457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 970/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:51 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:53.097689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:53.098291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:53.105258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:53.105811 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:53.106237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:53.107004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:53.107449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:53.107859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:53.171363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:53.181062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e4f36379-b164-440e-8f70-5c164f74268f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087145 Aug 24 08:19:53.181640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1034/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:53 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:54.202713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:54.203429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:54.209911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:54.210386 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:54.210819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:54.211502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:54.211948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:54.212366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:54.276119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:54.285016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c16b59c-b66c-426b-9d56-f740b2e901d0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086296 Aug 24 08:19:54.285585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 971/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:54 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:55.307150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:55.307752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:55.313641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:55.314106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:55.314531 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:55.315207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:55.315647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:55.316060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:55.375485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:55.383534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d513dc44-7692-4583-9396-c0ce92cee06a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.081292 Aug 24 08:19:55.384099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1035/2006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:55 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:56.404845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:56.405463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:56.412924 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:56.413403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:56.413837 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:56.414542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:56.414986 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:56.415402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:56.476184 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:56.484326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46fc01bb-04e5-4853-aae5-1de38dfcee2e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083439 Aug 24 08:19:56.484923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 972/2007] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:56 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:57.506820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:57.507420 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:57.514125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:57.514601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:57.515050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:57.515728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:57.516169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:57.516581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:57.580382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:57.587874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e849c155-bb60-4f90-ab3a-f25a2ce919aa tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085556 Aug 24 08:19:57.588439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1036/2008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:57 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:58.608560 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:58.609197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:58.615932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:58.616402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:58.616877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:58.617559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:58.618003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:58.618416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:58.681109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:58.689284 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-089c7945-93cb-40b6-a460-e121c2912870 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084548 Aug 24 08:19:58.689843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 973/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:58 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:19:59.711698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:19:59.712307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:19:59.718771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:59.719257 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:59.719687 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:59.720371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:19:59.720860 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:19:59.721280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:19:59.782165 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:19:59.790345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-618dacfe-bcff-48e2-ad1e-042bac93ef53 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083127 Aug 24 08:19:59.790849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1037/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:19:59 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:00.811450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:00.812053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:00.819064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:00.819531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:00.819957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:00.820628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:00.821110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:00.821525 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:00.885301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:00.893868 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-40a9ef95-e658-439e-b8a2-8ac8642651ee tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086247 Aug 24 08:20:00.894444 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 974/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:00 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:01.915327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:01.915985 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:01.922382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:01.922854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:01.923279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:01.923958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:01.924421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:01.924865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:01.996387 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:02.000139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7be16bd3-ef7d-47e6-88e8-fc940b937400 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.088964 Aug 24 08:20:02.000725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1038/2012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:01 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:03.022209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:03.022819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:03.025160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:03.030119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:03.030596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:03.031030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:03.031719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:03.032167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:03.032583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:03.093606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:03.102377 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae18b801-29f5-4b1f-ac8a-e4560e54bc61 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084705 Aug 24 08:20:03.102937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 975/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:03 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:04.123803 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:04.124263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:04.130564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:04.131048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:04.131481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:04.132168 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:04.132610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:04.133055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:04.195412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:04.203840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-46fe17b5-55ac-4c81-a376-01bcae62e752 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084282 Aug 24 08:20:04.204406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1039/2014] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:04 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:05.224240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:05.224937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:05.231376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:05.231847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:05.232277 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:05.232994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:05.233440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:05.233867 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:05.237806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=84 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:05.294856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:05.303919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b416438-b6a6-4e35-b752-5f3bb4ca9c9e tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083594 Aug 24 08:20:05.304482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 976/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:05 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:06.324698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:06.325330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:06.327613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=28 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:06.332467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:06.333015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:06.333447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:06.334135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:06.334584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:06.335074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:06.398653 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:06.406990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-73e6a11a-a3a5-4f19-8747-41c098b6fd7a tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.086161 Aug 24 08:20:06.407558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1040/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:06 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:07.428360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:07.429052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:07.435589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:07.436060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:07.436486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:07.437206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:07.437648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:07.438067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:07.498117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:07.506498 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dd853fac-5d33-43a4-a14b-300c1df3bc10 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082281 Aug 24 08:20:07.507067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 977/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:07 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:08.527545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:08.528104 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:08.534760 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:08.535238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:08.535665 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:08.537144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:08.537621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:08.538039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:08.541937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=84 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:08.601326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:08.609367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6dfc4087-fbbe-453c-b030-19e1dafef9d8 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.085917 Aug 24 08:20:08.609927 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1041/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:08 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:09.631725 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:09.632329 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:09.638746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:09.639213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:09.639642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:09.640323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:09.640797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:09.641216 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:09.707368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:09.715695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c6b64cc3-3115-43be-a043-896058130087 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.088616 Aug 24 08:20:09.716263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 978/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:09 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:10.736416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:10.737077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:10.743754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:10.744230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:10.744680 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:10.745365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:10.745883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:10.746301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:10.821452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:10.829535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6b8c9c51-79e7-4778-a05a-5084aa6b5292 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.096967 Aug 24 08:20:10.830330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1042/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:10 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:11.862354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:11.862959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:11.869801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:11.870278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:11.870703 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:11.871380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:11.871821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:11.872229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:11.934113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:11.942619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-116fb622-0e19-40cb-b335-b852f6266656 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083948 Aug 24 08:20:11.943190 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 979/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:11 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:12.963307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:12.963920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:12.970472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:12.970732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:12.971229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:12.971929 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:12.972503 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:12.972952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:13.043810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:13.053124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3738b217-47dd-4e2a-bc6a-1a926e5b1b0f tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.093522 Aug 24 08:20:13.053686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1043/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:12 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:20:14.073273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:14.073954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:14.080365 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:14.080930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:14.081354 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:14.082034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:14.082474 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:14.082884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:14.143952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:14.152357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a380d71f-28c9-4386-949d-582445ce6bf9 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082874 Aug 24 08:20:14.156900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 980/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:14 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:15.173352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:15.173963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:15.180714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:15.181198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:15.181629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:15.182312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:15.182763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:15.183185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:15.244284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:15.252685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a4d27f8a-f9de-4a85-8ae6-aab4e85ade0c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.083148 Aug 24 08:20:15.253256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1044/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:15 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:16.274606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:16.275220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:16.281669 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:16.282146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:16.282592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:16.283269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:16.283718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:16.284139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:16.344457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:16.352572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36336a2e-fd4c-412b-b20d-e7aa91c8cde1 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082522 Aug 24 08:20:16.353183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 981/2025] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:16 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:17.373905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:17.374512 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:17.381701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:17.382174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:17.382603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:17.383277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:17.383724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:17.384136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:17.446449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:17.454595 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-19eddc3d-237d-4820-a80a-91121e4353c0 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084566 Aug 24 08:20:17.455163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1045/2026] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:17 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:18.475753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:18.476630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:18.483078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:18.483551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:18.483977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:18.484695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:18.485157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:18.485609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:18.557760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:18.568369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d6f41ba-1ad1-4b15-9027-e7a676254de6 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.096689 Aug 24 08:20:18.569143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 982/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:18 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:19.589504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:19.590079 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:19.596782 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:19.597260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:19.597694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:19.598377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:19.598814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:19.599260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:19.665186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:19.673551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e2902cef-2a90-48ef-97ad-bc890fd0e429 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.087883 Aug 24 08:20:19.674126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1046/2028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:19 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:20.694696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:20.695214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:20.701557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:20.702023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:20.702446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:20.703126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:20.703562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:20.703975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:20.764782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:20.773463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-75a2abed-03c1-4a1f-aa8b-8df349959849 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082665 Aug 24 08:20:20.774026 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 983/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:20 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:21.793958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:21.794485 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:21.800903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:21.801368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:21.802048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:21.803561 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:21.804002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:21.804411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:21.863949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:21.872976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e298fbd1-278d-4db2-8661-6ea4f8b95563 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.082880 Aug 24 08:20:21.873533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1047/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:21 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:20:22.894609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:22.895214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:22.902385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:22.902853 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:22.903280 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:22.903949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:22.904388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:22.904832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:22.966916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:22.975080 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a6e25d1-a00f-4d3c-a137-93c8e2749f14 tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.084306 Aug 24 08:20:22.975635 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 984/2031] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:22 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:23.180419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:20:23.180975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:20:23.700332 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:23.700861 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:23.707026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:23.707501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:23.707934 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:23.709357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:23.709958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:23.710381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:23.724010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 HTTP/1.1 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:20:23.725835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.727582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '11a85e76-d571-436c-a306-a993465b6854'} Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:20:23.728475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.730589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.732218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:20:23.732218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-84c4feb3-b5a0-482b-8ad0-750eec26faeb tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 404 len: 111 microversion: 2.1 time: 0.030731 Aug 24 08:20:23.732218 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1048/2032] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:20:23 2022] DELETE /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:20:23.735619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:23.736230 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] [instance: 11a85e76-d571-436c-a306-a993465b6854] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:23.742366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:23.742843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:23.743274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:23.743957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:23.744408 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:23.744858 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:23.758543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] HTTP exception thrown: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Request method failure captured: Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 HTTP/1.1 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBdimr70p0eRvyUb2V0hnBDs4aBH0qFet2geIdUSoeMCRx-wiTiK-A-jpd0HKrO1Jd3QQ26zGjQa39fm0IJg0tB-1489OlYd4dc12HKvGMXZzy1q-QqEDrRgMaKd0OpdHPw4AVzqEkIDJRraygF-V344aGHHKISmwZ9ZW-ogVkHSz-f8 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:20:23.760048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7043fd37a1040c2af5d3f9f2943a791"}]}] Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: d7043fd37a1040c2af5d3f9f2943a791 Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-626934250 Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: 2ec3daa674814619976aead75459e98c Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-626934250-project Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.761779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '11a85e76-d571-436c-a306-a993465b6854'} Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:20:23.762651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. Aug 24 08:20:23.764002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:20:23.765335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] Returning 404 to user: Instance 11a85e76-d571-436c-a306-a993465b6854 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:20:23.765335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8bed3bf-5929-4583-b801-5a1d2290e21f tempest-AttachVolumeTestJSON-626934250 tempest-AttachVolumeTestJSON-626934250-project] 10.222.0.26 "GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854" status: 404 len: 111 microversion: 2.1 time: 0.029746 Aug 24 08:20:23.765335 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 985/2033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:23 2022] GET /compute/v2.1/servers/11a85e76-d571-436c-a306-a993465b6854 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:20:23.996386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:23.997025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] [instance: 810c41f4-f7ab-43b6-bbdb-81d52de49f0d] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:20:24.003157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:24.003635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:24.004067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:24.004776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:20:24.005244 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:20:24.006302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:20:24.094654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1a288170374d1a80355c869c78b4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b468fa5d3046ebb37fbd43102be471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:20:24.103659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-88ca0cb3-894b-4c72-85cb-03a20609039c tempest-VolumesSnapshotTestJSON-2112003404 tempest-VolumesSnapshotTestJSON-2112003404-project] 10.222.0.26 "GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d" status: 200 len: 1349 microversion: 2.1 time: 0.111097 Aug 24 08:20:24.104233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1049/2034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:20:23 2022] GET /compute/v2.1/servers/810c41f4-f7ab-43b6-bbdb-81d52de49f0d => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:20:29.263356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d3c2f2ed-4c2c-4ad2-9e29-59a0dea59a6d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Action: 'create', calling method: .version_select at 0x7f4562cec040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1177926758"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:20:29.939661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d3c2f2ed-4c2c-4ad2-9e29-59a0dea59a6d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.804829 Aug 24 08:20:29.940382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 986/2035] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Aug 24 08:20:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 806 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 08:20:29.963374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ff711139-6ed3-4fba-ad0b-1f550266013e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:30.020075 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ff711139-6ed3-4fba-ad0b-1f550266013e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.069101 Aug 24 08:20:30.021126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1050/2036] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:31.039199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-54ab81cb-1ba7-4156-adfb-d886ab57f9f6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c1c940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:31.085646 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-54ab81cb-1ba7-4156-adfb-d886ab57f9f6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051261 Aug 24 08:20:31.098689 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 987/2037] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:32.099580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-383b4cc7-0278-430d-a888-b61e9712db3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8db80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:32.146034 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-383b4cc7-0278-430d-a888-b61e9712db3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050694 Aug 24 08:20:32.147094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1051/2038] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:33.011037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:20:33.011603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:20:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:20:33.159980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d752db98-8570-4967-a030-747ee288c239 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:33.206063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d752db98-8570-4967-a030-747ee288c239 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050234 Aug 24 08:20:33.206622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 988/2039] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:34.217471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=19 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:34.218293 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=49 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:34.222185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c8110c91-abc6-49aa-a929-d766b32707ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:34.269012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c8110c91-abc6-49aa-a929-d766b32707ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052621 Aug 24 08:20:34.269581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1052/2040] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:35.280137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=21 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:35.280946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=55 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:35.285237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d625599-6da3-4c46-bc29-308f506a4838 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72ab80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:35.332030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d625599-6da3-4c46-bc29-308f506a4838 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052503 Aug 24 08:20:35.332591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 989/2041] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:36.346754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-059c8d35-7903-4f03-b75a-ae02be9f61c1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d660d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:36.393611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-059c8d35-7903-4f03-b75a-ae02be9f61c1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051684 Aug 24 08:20:36.394210 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1053/2042] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:20:37.407905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b8c4918-6b35-4651-af27-ad94e3c488d5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568038ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:37.453225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b8c4918-6b35-4651-af27-ad94e3c488d5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049659 Aug 24 08:20:37.453785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 990/2043] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:38.468173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5d803ef2-bddc-41de-a723-499c9f686f5d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:38.513977 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5d803ef2-bddc-41de-a723-499c9f686f5d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050077 Aug 24 08:20:38.514533 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1054/2044] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:39.527978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-26b51afc-eee7-4de0-a296-dee53f0589e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbae50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:39.574992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-26b51afc-eee7-4de0-a296-dee53f0589e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051396 Aug 24 08:20:39.575564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 991/2045] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:40.591157 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-98f75c9b-f724-4b84-a665-177a4f2b2167 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:40.637445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-98f75c9b-f724-4b84-a665-177a4f2b2167 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050513 Aug 24 08:20:40.637991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1055/2046] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:40.869064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:20:40.869609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:20:41.651888 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-431d8ebe-5a9c-4cd2-8035-039e29ae5347 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aa60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:41.698594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-431d8ebe-5a9c-4cd2-8035-039e29ae5347 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051128 Aug 24 08:20:41.699234 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 992/2047] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:42.721408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ddfe74aa-399f-4ffb-8a1c-c411dd276d4b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:42.775753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ddfe74aa-399f-4ffb-8a1c-c411dd276d4b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052070 Aug 24 08:20:42.775753 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1056/2048] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:43.787770 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-86fcef8f-0418-4a34-991a-f4d8c64e64c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:43.833604 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-86fcef8f-0418-4a34-991a-f4d8c64e64c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050284 Aug 24 08:20:43.834167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 993/2049] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:44.847167 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-18999655-6498-4968-98b5-af58b4c02217 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562e47ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:44.893279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-18999655-6498-4968-98b5-af58b4c02217 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049760 Aug 24 08:20:44.893850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1057/2050] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:45.908007 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e5767c2f-96d0-427e-8716-8a027d792136 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72a670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:45.953435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e5767c2f-96d0-427e-8716-8a027d792136 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049702 Aug 24 08:20:45.954002 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 994/2051] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:46.967308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fdad4130-499d-4c72-8f3d-eaf4ea03f49e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d971f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:47.013089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fdad4130-499d-4c72-8f3d-eaf4ea03f49e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050133 Aug 24 08:20:47.013641 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1058/2052] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:48.027418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-abaad0b2-d9c7-42f1-a1c4-e910b68ff4d1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:48.073476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-abaad0b2-d9c7-42f1-a1c4-e910b68ff4d1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050654 Aug 24 08:20:48.074028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 995/2053] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:49.088725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6947c369-3958-4592-89e1-f7a067fb6430 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:49.133724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6947c369-3958-4592-89e1-f7a067fb6430 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049986 Aug 24 08:20:49.134255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1059/2054] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:50.148328 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-85a0067e-7420-4781-8c60-7a6f1394a878 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c93280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:50.193472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-85a0067e-7420-4781-8c60-7a6f1394a878 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050184 Aug 24 08:20:50.194034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 996/2055] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:51.207371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6faece47-21db-4efe-bac1-c3b64a99e9c4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675d30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:51.253347 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6faece47-21db-4efe-bac1-c3b64a99e9c4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050334 Aug 24 08:20:51.253913 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1060/2056] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:52.267537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1043736-4df2-4ad0-9e89-44316ac270dc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cba550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:52.312563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1043736-4df2-4ad0-9e89-44316ac270dc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049186 Aug 24 08:20:52.313170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 997/2057] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:53.329233 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4698bd33-ac91-47a1-8980-609e7ce2927f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:53.375270 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4698bd33-ac91-47a1-8980-609e7ce2927f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050184 Aug 24 08:20:53.375847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1061/2058] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:54.389202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-99ef84f5-0792-4a55-a996-288f5f1f9d91 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:54.435369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-99ef84f5-0792-4a55-a996-288f5f1f9d91 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050501 Aug 24 08:20:54.435984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 998/2059] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:55.450570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9965555d-dcc8-46f7-bcff-ccc5139787fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:55.496106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9965555d-dcc8-46f7-bcff-ccc5139787fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049823 Aug 24 08:20:55.496699 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1062/2060] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:20:56.510775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8fea8c61-f624-4244-a168-510ec67ba5b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbae50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:56.556262 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8fea8c61-f624-4244-a168-510ec67ba5b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050340 Aug 24 08:20:56.556862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 999/2061] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:57.570300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d29a3a19-bb5a-40b9-8f96-d232b4fc5b55 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:57.621692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d29a3a19-bb5a-40b9-8f96-d232b4fc5b55 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.055673 Aug 24 08:20:57.622254 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1063/2062] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:58.636118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-038e738f-609c-49a3-afcf-ca8a30a59f3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:58.689943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-038e738f-609c-49a3-afcf-ca8a30a59f3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058537 Aug 24 08:20:58.690523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1000/2063] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:20:59.705098 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-92d64e0b-dfae-4898-9d8d-09b5651db302 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d830d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:20:59.759686 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-92d64e0b-dfae-4898-9d8d-09b5651db302 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058790 Aug 24 08:20:59.760262 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1064/2064] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:20:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:00.774348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2b7b87b7-21f0-49c1-8122-3ce2adda918b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c2d670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:00.828348 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2b7b87b7-21f0-49c1-8122-3ce2adda918b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058980 Aug 24 08:21:00.828942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1001/2065] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:01.841918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2389e022-76ad-440b-8b9b-d1c059d6cb9f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d979d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:01.900184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2389e022-76ad-440b-8b9b-d1c059d6cb9f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062689 Aug 24 08:21:01.900798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1065/2066] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:02.912981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83bdc568-afda-44aa-9dd4-50227f5253db tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:02.971930 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83bdc568-afda-44aa-9dd4-50227f5253db tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062669 Aug 24 08:21:02.972500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1002/2067] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:03.985425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ae9f448c-d005-4672-a98b-1f61ec29c3b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63f4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:04.041290 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ae9f448c-d005-4672-a98b-1f61ec29c3b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060068 Aug 24 08:21:04.041859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1066/2068] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:05.055421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-280f4835-4b87-4892-a167-a9e5744bd7c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73be50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:05.121442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-280f4835-4b87-4892-a167-a9e5744bd7c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.070664 Aug 24 08:21:05.121855 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1003/2069] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:06.136335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-35f011c5-a40a-4a96-a1ac-7d6a56d93038 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:06.185799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-35f011c5-a40a-4a96-a1ac-7d6a56d93038 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054538 Aug 24 08:21:06.186372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1067/2070] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:07.199718 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fa07567c-6407-4206-bbd0-22d0aaf93b1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c2ddc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:07.255688 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fa07567c-6407-4206-bbd0-22d0aaf93b1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060213 Aug 24 08:21:07.256295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1004/2071] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:08.272833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5a21a259-d0ac-4f22-af29-ea9219115383 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d975e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:08.329181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5a21a259-d0ac-4f22-af29-ea9219115383 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063452 Aug 24 08:21:08.329740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1068/2072] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:09.347601 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-12ad4419-49a3-4dd9-b323-cf9ed7e35717 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:09.398016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-12ad4419-49a3-4dd9-b323-cf9ed7e35717 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054642 Aug 24 08:21:09.398584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1005/2073] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:10.411607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-26c04cc4-bba8-4dff-9298-6f534e4ce16e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:10.471678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-26c04cc4-bba8-4dff-9298-6f534e4ce16e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063912 Aug 24 08:21:10.472250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1069/2074] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:11.485639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9bafee9c-e48c-4b65-b2f4-ce174a3cc35e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:11.539666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9bafee9c-e48c-4b65-b2f4-ce174a3cc35e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058280 Aug 24 08:21:11.540233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1006/2075] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:12.554849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-937a6e04-c54c-4958-96f1-1ff284c1236e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b700700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:12.613821 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-937a6e04-c54c-4958-96f1-1ff284c1236e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064248 Aug 24 08:21:12.614398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1070/2076] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:13.627564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-231de5b8-fde2-4371-ad7e-41feac3250c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c06550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:13.682925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-231de5b8-fde2-4371-ad7e-41feac3250c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059581 Aug 24 08:21:13.683491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1007/2077] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:14.696548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-13d68b8e-59c2-46dd-9269-b6fb7db4a8ee tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b700160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:14.758203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-13d68b8e-59c2-46dd-9269-b6fb7db4a8ee tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065487 Aug 24 08:21:14.758774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1071/2078] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:15.772049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fa4e0af4-deae-4181-b259-6fe5380f1101 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:15.825796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fa4e0af4-deae-4181-b259-6fe5380f1101 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058107 Aug 24 08:21:15.826352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1008/2079] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:16.840473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0967704a-12be-42d6-826d-4ede454aba2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:16.895658 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0967704a-12be-42d6-826d-4ede454aba2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059461 Aug 24 08:21:16.896230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1072/2080] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:17.910628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e8fb1126-2364-4654-9100-1306aeb58c7c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4ba60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:17.965082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e8fb1126-2364-4654-9100-1306aeb58c7c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058690 Aug 24 08:21:17.965644 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1009/2081] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:18.977957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e43aff7-f978-4214-b6d9-29521b1375ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568c1eb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:19.040880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e43aff7-f978-4214-b6d9-29521b1375ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066659 Aug 24 08:21:19.041449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1073/2082] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:20.055420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7b476f66-a483-45f1-ad30-1a0bdb44a6be tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c06ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:20.122712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7b476f66-a483-45f1-ad30-1a0bdb44a6be tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.072393 Aug 24 08:21:20.123340 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1010/2083] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:21.137706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-19c73af3-7b41-4a8a-8ab8-2bb8466e7d77 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562e1b4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:21.190083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-19c73af3-7b41-4a8a-8ab8-2bb8466e7d77 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056938 Aug 24 08:21:21.190660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1074/2084] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:21:22.204961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-369529d5-655e-4c3a-8e48-a594038ee456 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:22.421514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-369529d5-655e-4c3a-8e48-a594038ee456 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.220987 Aug 24 08:21:22.422099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1011/2085] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:23.435793 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc3407e4-ac98-413e-adc9-f9660acb105b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:23.480580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc3407e4-ac98-413e-adc9-f9660acb105b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049234 Aug 24 08:21:23.481189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1075/2086] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:24.494683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c1a2d158-3c7e-41ce-b724-4cdc8815a86d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:24.540052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c1a2d158-3c7e-41ce-b724-4cdc8815a86d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050044 Aug 24 08:21:24.540623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1012/2087] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:25.555135 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c59ec92d-9fb9-44cb-a165-7bb225ce934f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:25.602158 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c59ec92d-9fb9-44cb-a165-7bb225ce934f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052410 Aug 24 08:21:25.602798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1076/2088] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:26.616455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d5be7727-2a91-417c-9c5c-8414720d8c29 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:26.661387 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d5be7727-2a91-417c-9c5c-8414720d8c29 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049867 Aug 24 08:21:26.661971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1013/2089] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:27.675494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-93108e11-c245-45bf-adb0-25906b19b2b5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7333a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:27.722060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-93108e11-c245-45bf-adb0-25906b19b2b5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050655 Aug 24 08:21:27.722675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1077/2090] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:28.735842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8306bd5-098a-486b-af8c-6c76b4c4eeba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbaca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:28.782050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8306bd5-098a-486b-af8c-6c76b4c4eeba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050568 Aug 24 08:21:28.782614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1014/2091] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:29.796367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c5c78f0f-05d3-460e-a6a9-18db264d25e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:29.840743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c5c78f0f-05d3-460e-a6a9-18db264d25e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.048699 Aug 24 08:21:29.841298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1078/2092] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:30.854734 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-74412a5e-8042-43b5-bdfb-2212fc0f505a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c06d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:30.899543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-74412a5e-8042-43b5-bdfb-2212fc0f505a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049789 Aug 24 08:21:30.900214 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1015/2093] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:31.913614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9d3c47b0-06af-46db-bb53-d153800a139b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:31.960029 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9d3c47b0-06af-46db-bb53-d153800a139b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050552 Aug 24 08:21:31.960583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1079/2094] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:32.974020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a1b6d54d-af3d-48ec-8408-5986bd09bba8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cb80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:33.022049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a1b6d54d-af3d-48ec-8408-5986bd09bba8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051760 Aug 24 08:21:33.022865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1016/2095] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:34.036185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-32ebc6e0-dd30-4bff-9259-1e9dc37cf34f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63f4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:34.082814 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-32ebc6e0-dd30-4bff-9259-1e9dc37cf34f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050970 Aug 24 08:21:34.083527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1080/2096] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:35.097392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-75f46197-0e0e-491b-9781-2d3fca86b647 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:35.144137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-75f46197-0e0e-491b-9781-2d3fca86b647 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050984 Aug 24 08:21:35.144945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1017/2097] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:36.158234 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-02d7d7f5-7480-4f1d-867d-640eace625a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:36.202415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-02d7d7f5-7480-4f1d-867d-640eace625a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.048399 Aug 24 08:21:36.202980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1081/2098] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:37.216119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-075f4593-1e20-4a2c-87b7-c03a3aa02ad4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bf70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:37.259958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-075f4593-1e20-4a2c-87b7-c03a3aa02ad4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.047976 Aug 24 08:21:37.260509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1018/2099] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:38.274418 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fd750e3e-f123-4b2a-a538-3de28e3fe18a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:38.337278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fd750e3e-f123-4b2a-a538-3de28e3fe18a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067650 Aug 24 08:21:38.337850 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1082/2100] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:39.351312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e2c3f66-023e-4373-a026-e31783520d97 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a9d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:39.403587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e2c3f66-023e-4373-a026-e31783520d97 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056680 Aug 24 08:21:39.404170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1019/2101] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:40.418054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe6ec70c-ef68-472f-872c-79ce297c59a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:40.473835 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe6ec70c-ef68-472f-872c-79ce297c59a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060085 Aug 24 08:21:40.474440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1083/2102] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:41.487582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bb7474b1-436b-4699-b146-64cb1e290829 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbaca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:41.543583 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bb7474b1-436b-4699-b146-64cb1e290829 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060195 Aug 24 08:21:41.544152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1020/2103] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:42.557715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8311c913-fec6-4108-9453-3b176b267d33 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d975e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:42.616799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8311c913-fec6-4108-9453-3b176b267d33 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063324 Aug 24 08:21:42.617365 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1084/2104] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:43.630903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c666b0f-127a-42d1-aca5-a27bd479ff37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71fee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:43.687869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6c666b0f-127a-42d1-aca5-a27bd479ff37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061321 Aug 24 08:21:43.688437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1021/2105] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:44.702284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ba21811c-45a4-4df3-a7cf-21919f6cba78 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:44.757831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ba21811c-45a4-4df3-a7cf-21919f6cba78 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059073 Aug 24 08:21:44.758411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1085/2106] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:45.772397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d0fdd4bd-56be-4894-b721-db2768514a83 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:45.830885 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d0fdd4bd-56be-4894-b721-db2768514a83 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062923 Aug 24 08:21:45.831452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1022/2107] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:46.844996 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e99925d8-44fb-4a1c-8ade-485041c38599 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:46.901058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e99925d8-44fb-4a1c-8ade-485041c38599 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060236 Aug 24 08:21:46.901674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1086/2108] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:47.916182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d448857-5182-4bde-bbfe-757a6ef93257 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:47.970159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d448857-5182-4bde-bbfe-757a6ef93257 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059211 Aug 24 08:21:47.970727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1023/2109] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:48.983026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-82130e4a-e5a6-4f54-9252-86da1159bb23 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:49.045125 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-82130e4a-e5a6-4f54-9252-86da1159bb23 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065674 Aug 24 08:21:49.045696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1087/2110] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:50.059611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7517c6c9-1f39-47a2-8a8f-16a93ef82c56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:50.116798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7517c6c9-1f39-47a2-8a8f-16a93ef82c56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061398 Aug 24 08:21:50.117366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1024/2111] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:51.131109 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ee0e32ce-7f36-4db7-a682-c256454a6aca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:51.184705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ee0e32ce-7f36-4db7-a682-c256454a6aca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058002 Aug 24 08:21:51.185274 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1088/2112] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:52.199606 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-51c4cb8a-a953-4093-891a-da53a6f353a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c73f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:52.256921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-51c4cb8a-a953-4093-891a-da53a6f353a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061101 Aug 24 08:21:52.257830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1025/2113] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:53.271171 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f9b21bda-03ba-4f0e-b256-c29730f6f9cb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:53.325151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f9b21bda-03ba-4f0e-b256-c29730f6f9cb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058081 Aug 24 08:21:53.325719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1089/2114] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:54.340091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cbf045ff-e4c4-43e7-be03-8effaea4c597 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:54.396238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cbf045ff-e4c4-43e7-be03-8effaea4c597 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061262 Aug 24 08:21:54.397416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1026/2115] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:54.937250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:21:54.937857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:21:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:21:55.411141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e577a53-33c4-4326-a866-fd73e02860b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:55.466905 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e577a53-33c4-4326-a866-fd73e02860b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060148 Aug 24 08:21:55.467532 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1090/2116] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:56.480978 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-297d86ff-f1de-4005-8580-b1e1f185b6bc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbae50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:56.538417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-297d86ff-f1de-4005-8580-b1e1f185b6bc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061113 Aug 24 08:21:56.538980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1027/2117] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:57.551756 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-582884df-fe8e-4144-b4c7-1fad16aa5bb3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:57.610175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-582884df-fe8e-4144-b4c7-1fad16aa5bb3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062845 Aug 24 08:21:57.610745 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1091/2118] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:58.624362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d3f8796f-0a84-4c65-b4a9-7f6118cc438e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:58.691302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d3f8796f-0a84-4c65-b4a9-7f6118cc438e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.071021 Aug 24 08:21:58.691896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1028/2119] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:21:59.722008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2f384fbd-c74e-4697-aa5f-468f61efc7eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:21:59.767147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2f384fbd-c74e-4697-aa5f-468f61efc7eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.048964 Aug 24 08:21:59.767980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1092/2120] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:21:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:22:00.782509 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-731bc73a-7ae6-4fee-aaea-170b16de1c1e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:00.828984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-731bc73a-7ae6-4fee-aaea-170b16de1c1e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049679 Aug 24 08:22:00.828984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1029/2121] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:01.843068 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2aa4bcd7-09b9-4e98-a9cf-b246033cd21a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d984c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:01.898438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2aa4bcd7-09b9-4e98-a9cf-b246033cd21a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059582 Aug 24 08:22:01.899002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1093/2122] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:02.911771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-16fb0694-ba74-46f5-805f-42e4bbef1e94 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:02.967846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-16fb0694-ba74-46f5-805f-42e4bbef1e94 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060419 Aug 24 08:22:02.968416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1030/2123] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:03.981499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec1daf44-26c9-4b70-bc09-e963e2e6bc8f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d831f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:04.041163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec1daf44-26c9-4b70-bc09-e963e2e6bc8f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063361 Aug 24 08:22:04.041732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1094/2124] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:05.055909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b892fb13-8b1a-40b5-af6a-1576c59a14ae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73bdc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:05.116626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b892fb13-8b1a-40b5-af6a-1576c59a14ae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065137 Aug 24 08:22:05.117221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1031/2125] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:06.146119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9694ba9b-f83c-4424-ab25-9b4f7c30c8a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:06.191312 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9694ba9b-f83c-4424-ab25-9b4f7c30c8a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049438 Aug 24 08:22:06.191884 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1095/2126] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:07.205015 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8e248cf4-b5d6-46db-8c0a-a83bc74d386c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec3a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:07.254186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8e248cf4-b5d6-46db-8c0a-a83bc74d386c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053571 Aug 24 08:22:07.254757 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1032/2127] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:08.269500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b9d78e94-ce99-437c-a3ce-45721f375131 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:08.327476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b9d78e94-ce99-437c-a3ce-45721f375131 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062088 Aug 24 08:22:08.328107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1096/2128] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:08.448077 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:22:08.448570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:22:09.341126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2c74626e-775a-41e9-b38d-3d999265119b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cdc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:09.396361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2c74626e-775a-41e9-b38d-3d999265119b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059344 Aug 24 08:22:09.396950 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1033/2129] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:10.410188 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3f556f3-1063-4499-83d6-b51ed8ee51f2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:10.469684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3f556f3-1063-4499-83d6-b51ed8ee51f2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063618 Aug 24 08:22:10.470241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1097/2130] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:11.483527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1b55b55-471f-483d-8cd1-4af1292e242b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72ab80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:11.539991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1b55b55-471f-483d-8cd1-4af1292e242b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060660 Aug 24 08:22:11.540582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1034/2131] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:12.554014 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8bf7a7d2-6c4c-4e85-a020-7e893b4ed932 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:12.620746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8bf7a7d2-6c4c-4e85-a020-7e893b4ed932 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.070841 Aug 24 08:22:12.621317 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1098/2132] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:22:13.635799 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f6b4caa3-a6c2-4bc5-9c99-33d64c4a2d3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:13.686349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f6b4caa3-a6c2-4bc5-9c99-33d64c4a2d3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.055829 Aug 24 08:22:13.686915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1035/2133] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:14.699534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d61dfc70-c83a-4267-a168-6ba158094731 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:14.756599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d61dfc70-c83a-4267-a168-6ba158094731 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061152 Aug 24 08:22:14.757223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1099/2134] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:15.781887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-49216f7c-3d28-48c4-9161-385fcad5f996 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:15.831353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-49216f7c-3d28-48c4-9161-385fcad5f996 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053745 Aug 24 08:22:15.832076 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1036/2135] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:16.845714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf86c66d-e324-423d-bda2-1fc172498258 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:16.898421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf86c66d-e324-423d-bda2-1fc172498258 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057039 Aug 24 08:22:16.898986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1100/2136] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:17.911342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-846e4fb2-bac1-499b-8504-1fe7e819d18e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b8b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:17.970210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-846e4fb2-bac1-499b-8504-1fe7e819d18e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062918 Aug 24 08:22:17.970774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1037/2137] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:18.985018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d55ad420-e634-4e57-bd5d-fb6446da24eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:19.044874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d55ad420-e634-4e57-bd5d-fb6446da24eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062405 Aug 24 08:22:19.044874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1101/2138] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:20.057650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fa261788-2015-4c66-aaff-9f27dd9641cd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8bf70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:20.116345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fa261788-2015-4c66-aaff-9f27dd9641cd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063009 Aug 24 08:22:20.116953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1038/2139] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:21.130801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e83925c7-f962-4ed2-a8ed-6012c8a092d0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d5e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:21.191906 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e83925c7-f962-4ed2-a8ed-6012c8a092d0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065632 Aug 24 08:22:21.192474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1102/2140] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:22.206162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e5a0122b-b24b-4a81-a5c3-118ca165d154 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:22.258521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e5a0122b-b24b-4a81-a5c3-118ca165d154 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056496 Aug 24 08:22:22.259197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1039/2141] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:23.272179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-760a717f-257e-45e7-a4f3-b886818153f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6b280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:23.328422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-760a717f-257e-45e7-a4f3-b886818153f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061139 Aug 24 08:22:23.329051 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1103/2142] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:24.343851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e875c7dd-098b-4361-b3f6-ef9d850dc5ae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:24.398110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e875c7dd-098b-4361-b3f6-ef9d850dc5ae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058871 Aug 24 08:22:24.398672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1040/2143] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:25.411491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3b67db81-1ac2-4148-9b86-e56da93b4125 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:25.471340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3b67db81-1ac2-4148-9b86-e56da93b4125 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064015 Aug 24 08:22:25.471979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1104/2144] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:26.486298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-512347d3-6b73-4c07-af30-06ab7ff6e306 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd09d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:26.541406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-512347d3-6b73-4c07-af30-06ab7ff6e306 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059344 Aug 24 08:22:26.542108 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1041/2145] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:27.554941 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ea0873cb-ec6a-40fa-8299-99fdc23a86b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d834c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:27.613398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ea0873cb-ec6a-40fa-8299-99fdc23a86b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062008 Aug 24 08:22:27.613965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1105/2146] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:28.627424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3788d267-feaf-4532-ab52-981e442f8353 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c569d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:28.841384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3788d267-feaf-4532-ab52-981e442f8353 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.218086 Aug 24 08:22:28.841944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1042/2147] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:29.855272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-33a4b9ef-b30e-4864-80a9-5154f6210abc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6be50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:29.901417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-33a4b9ef-b30e-4864-80a9-5154f6210abc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050364 Aug 24 08:22:29.901983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1106/2148] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:30.914798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-afa01aea-eaa1-4228-8973-126121f26210 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b4c0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:30.960295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-afa01aea-eaa1-4228-8973-126121f26210 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049770 Aug 24 08:22:30.960905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1043/2149] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:31.975017 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5cc35113-ab4a-419e-b427-2fe95301c186 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:32.019810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5cc35113-ab4a-419e-b427-2fe95301c186 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049621 Aug 24 08:22:32.020407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1107/2150] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:33.034896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-52282fcb-d5c2-4eb9-ab76-4619cccf2e02 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72ab80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:33.080748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-52282fcb-d5c2-4eb9-ab76-4619cccf2e02 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050121 Aug 24 08:22:33.081317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1044/2151] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:34.095198 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2ee3d2d9-7dd6-4ada-958b-2c8414475584 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b700ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:34.141501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2ee3d2d9-7dd6-4ada-958b-2c8414475584 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050684 Aug 24 08:22:34.146571 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1108/2152] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:35.155704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b5e94cb9-de7d-4326-90f3-329de9d39c83 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c740d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:35.203162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b5e94cb9-de7d-4326-90f3-329de9d39c83 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051679 Aug 24 08:22:35.203678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1045/2153] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:36.218310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c5c5f640-ad5a-4219-93ed-adb86be1b95f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfa60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:36.263654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c5c5f640-ad5a-4219-93ed-adb86be1b95f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050120 Aug 24 08:22:36.264214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1109/2154] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:37.277679 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-41a21d6d-5948-4281-a831-a11e02f07bf6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8ba60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:37.323051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-41a21d6d-5948-4281-a831-a11e02f07bf6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049621 Aug 24 08:22:37.323613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1046/2155] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:38.338074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58ae81e4-24a2-4b23-822f-04467ff0d56e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:38.383912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58ae81e4-24a2-4b23-822f-04467ff0d56e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051099 Aug 24 08:22:38.384494 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1110/2156] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:39.397742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9e5e9c0c-3e52-47d3-bc7b-760250074a03 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:39.442901 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9e5e9c0c-3e52-47d3-bc7b-760250074a03 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049203 Aug 24 08:22:39.443577 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1047/2157] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:40.457025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9a37cb68-ab2f-43c5-b7ea-7a4e042caf25 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:40.501752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9a37cb68-ab2f-43c5-b7ea-7a4e042caf25 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049066 Aug 24 08:22:40.502308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1111/2158] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:41.515788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af0039d1-7f65-48e7-b8c3-706d1ce70871 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:41.561705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af0039d1-7f65-48e7-b8c3-706d1ce70871 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050064 Aug 24 08:22:41.562268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1048/2159] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:42.575601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1116d460-246b-425f-9d1e-b583225575cb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6b280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:42.620583 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1116d460-246b-425f-9d1e-b583225575cb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049099 Aug 24 08:22:42.621196 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1112/2160] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:43.635469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8cff6138-3e41-40aa-8957-bc8dbbab4ad6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:43.691841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8cff6138-3e41-40aa-8957-bc8dbbab4ad6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061465 Aug 24 08:22:43.692435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1049/2161] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:44.708729 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd457db2-7295-4773-bf9e-9329af7acddb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:44.770095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd457db2-7295-4773-bf9e-9329af7acddb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067218 Aug 24 08:22:44.770692 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1113/2162] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:45.783630 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1f788033-eebd-4286-a894-f2a02d0a063c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:45.834561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1f788033-eebd-4286-a894-f2a02d0a063c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.055182 Aug 24 08:22:45.835127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1050/2163] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:46.849013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cd1345fa-0528-4c5f-8c3d-9e022b80963b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:46.908119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cd1345fa-0528-4c5f-8c3d-9e022b80963b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063186 Aug 24 08:22:46.908698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1114/2164] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:47.922900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-32feda4f-e1af-4e10-b2ca-b58fe0c1741f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:47.978507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-32feda4f-e1af-4e10-b2ca-b58fe0c1741f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060215 Aug 24 08:22:47.979112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1051/2165] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:48.994278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b8efcbf-2f86-4d15-b705-64b11a825ddd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8db80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:49.057673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b8efcbf-2f86-4d15-b705-64b11a825ddd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068925 Aug 24 08:22:49.058340 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1115/2166] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:50.072267 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b8e9dc9-f456-4aab-ac24-9d358af662ce tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:50.124737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b8e9dc9-f456-4aab-ac24-9d358af662ce tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057406 Aug 24 08:22:50.125379 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1052/2167] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:51.141189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a5ab9bea-c884-4b65-b673-2e8a8b646d76 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6b9d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:51.211893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a5ab9bea-c884-4b65-b673-2e8a8b646d76 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.074748 Aug 24 08:22:51.211893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1116/2168] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:52.224479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-efe4e5cd-5de1-4055-b2af-a698605380a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c409d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:52.269716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-efe4e5cd-5de1-4055-b2af-a698605380a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049436 Aug 24 08:22:52.270276 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1053/2169] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:53.283517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ca7b969c-5f64-42d2-9090-af61ae958f4a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:53.336205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ca7b969c-5f64-42d2-9090-af61ae958f4a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056754 Aug 24 08:22:53.336829 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1117/2170] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:54.350487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9a2faf6b-ffdb-42ee-bcbc-f6dc01cddae1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c93280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:54.410632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9a2faf6b-ffdb-42ee-bcbc-f6dc01cddae1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064538 Aug 24 08:22:54.411225 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1054/2171] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:55.425456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d0474476-4512-45e2-a07d-78fd41697b2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6b280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:55.481880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d0474476-4512-45e2-a07d-78fd41697b2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060986 Aug 24 08:22:55.482439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1118/2172] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:56.496123 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36ad4047-f234-4629-be02-ff83ab427d7e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733c10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:56.552502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36ad4047-f234-4629-be02-ff83ab427d7e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060787 Aug 24 08:22:56.553103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1055/2173] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:57.566897 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8865a8bb-4c76-4abe-80cd-a2388a8a0d37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:57.625948 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8865a8bb-4c76-4abe-80cd-a2388a8a0d37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063348 Aug 24 08:22:57.626541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1119/2174] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:58.639707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5abbf605-0648-443a-b84f-146b6ee55a04 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:58.697218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5abbf605-0648-443a-b84f-146b6ee55a04 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061800 Aug 24 08:22:58.697787 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1056/2175] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:22:59.711103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-662c1dfb-8113-4398-98f7-55fde6519b01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:22:59.769160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-662c1dfb-8113-4398-98f7-55fde6519b01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062279 Aug 24 08:22:59.769725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1120/2176] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:22:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:00.783257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5dfa28f6-ee6f-4ebb-9190-e26a0ac180a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:00.836063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5dfa28f6-ee6f-4ebb-9190-e26a0ac180a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056641 Aug 24 08:23:00.836619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1057/2177] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:01.849070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-79f63d6a-50e8-4f2c-9632-ecbfe89f4020 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:01.908253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-79f63d6a-50e8-4f2c-9632-ecbfe89f4020 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063367 Aug 24 08:23:01.908879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1121/2178] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:02.921607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c23856c9-b676-4c68-bf99-9f85a0833917 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:02.982178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c23856c9-b676-4c68-bf99-9f85a0833917 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064693 Aug 24 08:23:02.982740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1058/2179] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:03.996779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-38095ef4-9ec5-44c2-a8ef-985dcea45266 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:04.052462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-38095ef4-9ec5-44c2-a8ef-985dcea45266 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061093 Aug 24 08:23:04.053069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1122/2180] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:05.067462 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f163f8ce-c65e-4a2f-b54a-fa8c6cae6b25 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c408b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:05.127736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f163f8ce-c65e-4a2f-b54a-fa8c6cae6b25 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064958 Aug 24 08:23:05.128305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1059/2181] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:06.143336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25a47be8-85fd-4f5e-88bc-df9075d62245 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6750d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:06.192998 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25a47be8-85fd-4f5e-88bc-df9075d62245 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053854 Aug 24 08:23:06.193564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1123/2182] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:07.207068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46fafd5f-506e-4bcd-a505-f41fa5452c6f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd03a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:07.262643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46fafd5f-506e-4bcd-a505-f41fa5452c6f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059900 Aug 24 08:23:07.263203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1060/2183] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:08.276892 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8db85c52-0326-4fa0-9d3c-f50f7f4ef330 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:08.344476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8db85c52-0326-4fa0-9d3c-f50f7f4ef330 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.072237 Aug 24 08:23:08.345094 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1124/2184] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:09.358886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-04cfff3c-ac42-4e7c-95b6-d87a2c167d5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:09.406456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-04cfff3c-ac42-4e7c-95b6-d87a2c167d5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051800 Aug 24 08:23:09.407022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1061/2185] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:10.419980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-abc90fbd-2ea5-4115-8415-8a1f69e9eb6a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:10.478222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-abc90fbd-2ea5-4115-8415-8a1f69e9eb6a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062386 Aug 24 08:23:10.478789 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1125/2186] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:11.491437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-711c3b99-0661-4f62-9b93-0d2ff054d58d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74e50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:11.551983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-711c3b99-0661-4f62-9b93-0d2ff054d58d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064688 Aug 24 08:23:11.552553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1062/2187] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:12.566089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-afe91112-f523-404e-88d6-afe86a176b6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b9d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:12.620754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-afe91112-f523-404e-88d6-afe86a176b6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058832 Aug 24 08:23:12.621355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1126/2188] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:13.634665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-de7d585e-5b20-47b8-b952-a70a58d8e970 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:13.693895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-de7d585e-5b20-47b8-b952-a70a58d8e970 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063434 Aug 24 08:23:13.694456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1063/2189] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:14.707504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3fb2ba15-beae-44d2-94f7-c2ad6eba3dd6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5b80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:14.763283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3fb2ba15-beae-44d2-94f7-c2ad6eba3dd6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059883 Aug 24 08:23:14.763847 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1127/2190] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:15.777033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca94fd5f-3590-4d95-9afd-dbe53b290fea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74e50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:15.833876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca94fd5f-3590-4d95-9afd-dbe53b290fea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061663 Aug 24 08:23:15.834440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1064/2191] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:16.847856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-47fb53c0-0055-4a34-ab74-8b6b4aca2f41 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d799d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:16.905701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-47fb53c0-0055-4a34-ab74-8b6b4aca2f41 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062337 Aug 24 08:23:16.906288 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1128/2192] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:17.919972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-38ab179a-739f-421b-9b55-1268404fc6b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45637331f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:17.977213 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-38ab179a-739f-421b-9b55-1268404fc6b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061501 Aug 24 08:23:17.977805 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1065/2193] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:18.990865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1eb5ae97-a452-4be5-90de-a66cfe66cca9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:19.047092 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1eb5ae97-a452-4be5-90de-a66cfe66cca9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060345 Aug 24 08:23:19.047643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1129/2194] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:20.060274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5d76a447-b341-413c-8455-6e2a25cc3986 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c408b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:20.122268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5d76a447-b341-413c-8455-6e2a25cc3986 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065562 Aug 24 08:23:20.122863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1066/2195] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:21.135856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-97db4202-df90-4ec7-840b-1f968590c8c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d79ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:21.191453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-97db4202-df90-4ec7-840b-1f968590c8c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056207 Aug 24 08:23:21.191453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1130/2196] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:22.203447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-82e1279d-e4ce-4f39-8c7e-58a56c0342bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:22.275875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-82e1279d-e4ce-4f39-8c7e-58a56c0342bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.076519 Aug 24 08:23:22.276473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1067/2197] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:23.291253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-643bc841-745f-40bd-9c4c-d666e24e110d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bf820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:23.336273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-643bc841-745f-40bd-9c4c-d666e24e110d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050166 Aug 24 08:23:23.336887 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1131/2198] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:24.350461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e2dc8e3f-12b1-4dff-aa8b-093802b9525f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5ca60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:24.410358 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e2dc8e3f-12b1-4dff-aa8b-093802b9525f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064102 Aug 24 08:23:24.410922 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1068/2199] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:25.425413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30cda88f-0926-436c-9ed5-2cb0c95dde7e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db74c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:25.477577 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30cda88f-0926-436c-9ed5-2cb0c95dde7e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056717 Aug 24 08:23:25.478139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1132/2200] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:26.491553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8207c983-d440-44a0-8f05-d3fee4fd3dbf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:26.552054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8207c983-d440-44a0-8f05-d3fee4fd3dbf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064749 Aug 24 08:23:26.552626 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1069/2201] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:27.566673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e4944eaa-6c43-46e4-9299-372df1bcf160 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:27.620115 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e4944eaa-6c43-46e4-9299-372df1bcf160 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057683 Aug 24 08:23:27.620711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1133/2202] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:28.635681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf15fde4-870a-463b-bd9e-0bf9bcaed7d5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71fee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:28.694470 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf15fde4-870a-463b-bd9e-0bf9bcaed7d5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062908 Aug 24 08:23:28.695162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1070/2203] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:29.707428 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-01ba10c6-63ed-4049-9065-83dcd5838e3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bf70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:29.764581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-01ba10c6-63ed-4049-9065-83dcd5838e3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061253 Aug 24 08:23:29.765207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1134/2204] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:30.779095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5f277d80-b9af-4341-9bce-51c4f8b1dd8b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:30.832212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5f277d80-b9af-4341-9bce-51c4f8b1dd8b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057363 Aug 24 08:23:30.832813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1071/2205] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:31.847105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f48fba25-e448-41fb-99ec-a31ab229b9aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:31.908044 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f48fba25-e448-41fb-99ec-a31ab229b9aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065443 Aug 24 08:23:31.908727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1135/2206] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:32.922942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-170ccaf8-3641-4ba9-b6bf-0f73c4e33679 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:33.086576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-170ccaf8-3641-4ba9-b6bf-0f73c4e33679 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.167965 Aug 24 08:23:33.087143 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1072/2207] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:34.099378 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bfe37221-c452-4138-a5d6-af26501251a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:34.158331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bfe37221-c452-4138-a5d6-af26501251a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062992 Aug 24 08:23:34.158899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1136/2208] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:35.181621 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0e54851-f450-4720-8d3e-35fdfaab8932 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45637333a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:35.238110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0e54851-f450-4720-8d3e-35fdfaab8932 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063994 Aug 24 08:23:35.238699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1073/2209] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:36.252959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a664b8af-2058-432f-b444-99218826b4c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:36.303566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a664b8af-2058-432f-b444-99218826b4c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054242 Aug 24 08:23:36.304238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1137/2210] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:37.317778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c69f8a4a-0946-4b19-9f41-ec366e1bda34 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5ca60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:37.373388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c69f8a4a-0946-4b19-9f41-ec366e1bda34 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059945 Aug 24 08:23:37.373999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1074/2211] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:38.386719 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c1da5f3b-a211-432e-bd24-1bd0baa1c01f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:38.449524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c1da5f3b-a211-432e-bd24-1bd0baa1c01f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067075 Aug 24 08:23:38.450095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1138/2212] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:39.464091 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d8fb2ac-a6e1-442b-b3aa-0fec72666b32 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b9d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:39.516843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d8fb2ac-a6e1-442b-b3aa-0fec72666b32 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057642 Aug 24 08:23:39.517413 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1075/2213] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:40.531588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1d37024b-ee11-40c2-a553-a0253ad2d1fa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:40.592723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1d37024b-ee11-40c2-a553-a0253ad2d1fa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065197 Aug 24 08:23:40.593294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1139/2214] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:41.606704 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-346e0365-23d3-4779-bb3f-fa4cb0197b47 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:41.661493 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-346e0365-23d3-4779-bb3f-fa4cb0197b47 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058786 Aug 24 08:23:41.662629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1076/2215] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:42.677406 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-38d1f65c-5937-4a54-ba5d-c1fa783be60f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6b280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:42.735229 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-38d1f65c-5937-4a54-ba5d-c1fa783be60f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063951 Aug 24 08:23:42.735802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1140/2216] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:43.188564 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:23:43.188784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:23:43.748789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-23c0a6cb-08b8-47fc-b76a-3530d86fd727 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:43.805675 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-23c0a6cb-08b8-47fc-b76a-3530d86fd727 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060976 Aug 24 08:23:43.806247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1077/2217] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:44.820676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-daba83db-da1d-48e5-928a-0673c1565601 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:44.872326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-daba83db-da1d-48e5-928a-0673c1565601 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056965 Aug 24 08:23:44.872923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1141/2218] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:45.886902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-66e6b34e-23c4-4653-8f09-86c5fd1f50fa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:45.949147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-66e6b34e-23c4-4653-8f09-86c5fd1f50fa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066746 Aug 24 08:23:45.949712 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1078/2219] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:46.963298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58d565ad-dd25-4f66-b3ff-99bed0bbeea2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:47.015002 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58d565ad-dd25-4f66-b3ff-99bed0bbeea2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056036 Aug 24 08:23:47.015570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1142/2220] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:48.029366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-70e5a13e-7358-44b9-9013-a0126b5c3d1a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:48.089375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-70e5a13e-7358-44b9-9013-a0126b5c3d1a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064277 Aug 24 08:23:48.089953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1079/2221] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:49.104054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7d3230ec-410d-42a5-8749-10cb980faff9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675430>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:49.161504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7d3230ec-410d-42a5-8749-10cb980faff9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062326 Aug 24 08:23:49.162072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1143/2222] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:50.175814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dbf6c464-56bf-4ab6-a35d-a953039c8c73 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:50.237399 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dbf6c464-56bf-4ab6-a35d-a953039c8c73 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066055 Aug 24 08:23:50.237960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1080/2223] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:51.251565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0008dd80-1b6a-4e67-adad-5596aba09736 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63edc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:51.305748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0008dd80-1b6a-4e67-adad-5596aba09736 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058431 Aug 24 08:23:51.306309 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1144/2224] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:52.320928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-296daf79-a0e9-46d9-828a-36b6e0171128 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:52.377461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-296daf79-a0e9-46d9-828a-36b6e0171128 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061956 Aug 24 08:23:52.378032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1081/2225] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:53.019196 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:23:53.019423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:23:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:23:53.391779 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0630b919-f8f0-494e-95eb-03d71a619acd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:53.451519 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0630b919-f8f0-494e-95eb-03d71a619acd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064221 Aug 24 08:23:53.452208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1145/2226] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:54.465341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84b73b5a-a70e-4b91-af1a-c8361b65e49e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c741f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:54.520951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84b73b5a-a70e-4b91-af1a-c8361b65e49e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059764 Aug 24 08:23:54.521778 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1082/2227] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:55.535443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-85073942-07ec-411e-b2ab-9735b60aeec2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:55.598521 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-85073942-07ec-411e-b2ab-9735b60aeec2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067335 Aug 24 08:23:55.599096 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1146/2228] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:56.611680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-983a420e-5118-4ecc-a7c1-964f6780b728 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:56.666683 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-983a420e-5118-4ecc-a7c1-964f6780b728 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059305 Aug 24 08:23:56.667244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1083/2229] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:57.685635 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c5f98c34-234d-420d-9419-3442bf8efad9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:57.735530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c5f98c34-234d-420d-9419-3442bf8efad9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054061 Aug 24 08:23:57.736084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1147/2230] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:58.750875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6dd2fb63-b302-4147-96b2-51655db90e94 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:58.810516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6dd2fb63-b302-4147-96b2-51655db90e94 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063826 Aug 24 08:23:58.811079 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1084/2231] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:23:59.824530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-af041eb5-6eee-4523-9c29-9cc513f480e4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db70d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:23:59.880815 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-af041eb5-6eee-4523-9c29-9cc513f480e4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060494 Aug 24 08:23:59.881416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1148/2232] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:23:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:00.877145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:24:00.877622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:24:00.894586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-52dda935-bc91-4409-90c2-6b66bf6702ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:00.950733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-52dda935-bc91-4409-90c2-6b66bf6702ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060257 Aug 24 08:24:00.951312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1085/2233] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:01.965028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4fe33b5e-1948-4195-91ae-287856d1ca57 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6750d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:02.021175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4fe33b5e-1948-4195-91ae-287856d1ca57 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060266 Aug 24 08:24:02.021752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1149/2234] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:03.035296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a1f75f6-92fe-4fc6-81ea-f0d6323bb708 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:03.105022 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a1f75f6-92fe-4fc6-81ea-f0d6323bb708 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.073903 Aug 24 08:24:03.105585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1086/2235] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:03.232731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:24:03.233278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:24:04.119841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e70fb664-defd-400a-b282-66db27b6f3af tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:04.190499 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e70fb664-defd-400a-b282-66db27b6f3af tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.075513 Aug 24 08:24:04.191147 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1150/2236] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:05.206540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-96593fb1-a643-41c0-9611-e75f04e32efb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b9d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:05.267445 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-96593fb1-a643-41c0-9611-e75f04e32efb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066402 Aug 24 08:24:05.268034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1087/2237] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:06.282074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-329d0a37-9b02-47c1-811e-d9c01cba45f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db70d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:06.337746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-329d0a37-9b02-47c1-811e-d9c01cba45f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059811 Aug 24 08:24:06.338321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1151/2238] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:07.351575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c2cea119-8f29-48d3-bd99-f95efd8c0321 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:07.406706 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c2cea119-8f29-48d3-bd99-f95efd8c0321 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059391 Aug 24 08:24:07.407270 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1088/2239] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:08.419324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bf0fd34d-6c86-4b6c-bf7f-b6a3b2a10855 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:08.478774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bf0fd34d-6c86-4b6c-bf7f-b6a3b2a10855 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062480 Aug 24 08:24:08.478774 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1152/2240] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:09.492207 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5cf79855-64e0-448e-b063-9d6202ffbde0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4be50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:09.548582 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5cf79855-64e0-448e-b063-9d6202ffbde0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061183 Aug 24 08:24:09.549424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1089/2241] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:10.562888 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9623f841-d38c-417f-8429-f243331fa28e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:10.624604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9623f841-d38c-417f-8429-f243331fa28e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065918 Aug 24 08:24:10.625191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1153/2242] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:11.638551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7135e8f-e5f7-446e-904e-6e2e6e1e2dc6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:11.691405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7135e8f-e5f7-446e-904e-6e2e6e1e2dc6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057015 Aug 24 08:24:11.691963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1090/2243] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:12.705530 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e4bb579d-2595-4c4d-bf80-f59aab3482b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:12.769976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e4bb579d-2595-4c4d-bf80-f59aab3482b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068518 Aug 24 08:24:12.770541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1154/2244] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:13.784728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3e74218f-afe1-4138-9358-a633d08f646d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cf70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:13.845099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3e74218f-afe1-4138-9358-a633d08f646d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064662 Aug 24 08:24:13.845745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1091/2245] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:14.859763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-520b482b-77e0-4295-bc3e-80947513ca96 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:14.903972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-520b482b-77e0-4295-bc3e-80947513ca96 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.048468 Aug 24 08:24:14.904525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1155/2246] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:15.918639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3dbe0f74-ba9a-4ac4-8bdf-634c07618be8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:15.974717 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3dbe0f74-ba9a-4ac4-8bdf-634c07618be8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060206 Aug 24 08:24:15.975926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1092/2247] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:16.988527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1b918298-ac2a-48fa-8573-3169fa011b3c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83430>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:17.047008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1b918298-ac2a-48fa-8573-3169fa011b3c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062618 Aug 24 08:24:17.047646 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1156/2248] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:18.061571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f60a3e8-9814-4e66-aa5a-89d6d05f934d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bdc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:18.119119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f60a3e8-9814-4e66-aa5a-89d6d05f934d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061694 Aug 24 08:24:18.119674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1093/2249] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:19.134344 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-014ca406-68ba-41f7-b800-e400fa0af350 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db74c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:19.189084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-014ca406-68ba-41f7-b800-e400fa0af350 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059396 Aug 24 08:24:19.189731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1157/2250] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:20.202884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b1a07c88-4c52-44c3-82db-7d0055ce88fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:20.266793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b1a07c88-4c52-44c3-82db-7d0055ce88fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067441 Aug 24 08:24:20.267361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1094/2251] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:21.281872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f191d2d1-06c8-4557-bda8-d85bee9b0641 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5b80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:21.341491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f191d2d1-06c8-4557-bda8-d85bee9b0641 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063851 Aug 24 08:24:21.342047 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1158/2252] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:22.355698 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-837cf9af-fdf9-4d14-b920-7241a93162f6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7dee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:22.430326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-837cf9af-fdf9-4d14-b920-7241a93162f6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.078492 Aug 24 08:24:22.431162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1095/2253] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:23.444202 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5576d4d9-d22a-426f-ad80-8591996317cd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:23.577799 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5576d4d9-d22a-426f-ad80-8591996317cd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.138533 Aug 24 08:24:23.578368 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1159/2254] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:24.591710 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7809dd73-097f-4f13-bf90-3b1a94dd84c7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45637333a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:24.636900 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7809dd73-097f-4f13-bf90-3b1a94dd84c7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049366 Aug 24 08:24:24.637461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1096/2255] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:25.653695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-158407c5-b8a6-45de-8483-54d273fd8d72 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:25.776286 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-158407c5-b8a6-45de-8483-54d273fd8d72 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.126880 Aug 24 08:24:25.776947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1160/2256] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:26.790890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6daed388-478c-434a-b0f7-d922aefe2de3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:26.885233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6daed388-478c-434a-b0f7-d922aefe2de3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.099154 Aug 24 08:24:26.885824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1097/2257] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:27.898891 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c1c249c9-cb27-4f58-9c55-e758cd7abb01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:27.944033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c1c249c9-cb27-4f58-9c55-e758cd7abb01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049431 Aug 24 08:24:27.945426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1161/2258] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:28.958313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4340c6ee-916d-4a58-952e-a82269a4e5ff tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8bf70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:29.003705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4340c6ee-916d-4a58-952e-a82269a4e5ff tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049526 Aug 24 08:24:29.004274 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1098/2259] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:30.017852 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bd85ed62-2f1c-45d7-9894-220a6b7884d4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8da60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:30.063718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bd85ed62-2f1c-45d7-9894-220a6b7884d4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050034 Aug 24 08:24:30.064272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1162/2260] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:31.078793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78fa5575-e317-465a-a0d6-b537dbc74aec tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:31.124419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78fa5575-e317-465a-a0d6-b537dbc74aec tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049899 Aug 24 08:24:31.125024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1099/2261] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:32.138689 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-846d32e7-9c74-4ee2-8c8c-2de37a0ad4bd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db71f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:32.186475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-846d32e7-9c74-4ee2-8c8c-2de37a0ad4bd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052063 Aug 24 08:24:32.187058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1163/2262] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:33.200516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-26bd7de1-5307-496d-af33-d8a0b1aeb63f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d188b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:33.246822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-26bd7de1-5307-496d-af33-d8a0b1aeb63f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050648 Aug 24 08:24:33.247421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1100/2263] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:34.260480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a57b6833-2323-42aa-ba8c-e605a1ec3a2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:34.307050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a57b6833-2323-42aa-ba8c-e605a1ec3a2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050386 Aug 24 08:24:34.307611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1164/2264] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:35.320886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b6469bc-47c1-4943-8796-d94d384a0d1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74e50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:35.366535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b6469bc-47c1-4943-8796-d94d384a0d1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050086 Aug 24 08:24:35.367179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1101/2265] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:36.380205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-128cc5ad-5195-4ef2-a451-42605ba5e690 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:36.427442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-128cc5ad-5195-4ef2-a451-42605ba5e690 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051523 Aug 24 08:24:36.428005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1165/2266] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:37.441023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44002f63-bb80-47ac-b82d-317b0ca42036 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5ca60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:37.509127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44002f63-bb80-47ac-b82d-317b0ca42036 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.071640 Aug 24 08:24:37.509818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1102/2267] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:38.524039 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-72396262-dc38-473c-b61f-94260d4c0b80 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6c5310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:38.571466 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-72396262-dc38-473c-b61f-94260d4c0b80 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052544 Aug 24 08:24:38.572028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1166/2268] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:39.585584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4eeb9c2a-49b5-4ec9-9158-633277ae1855 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:39.632031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4eeb9c2a-49b5-4ec9-9158-633277ae1855 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050822 Aug 24 08:24:39.632592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1103/2269] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:40.644889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-27bfe8d7-de2b-47e2-adff-12055b5f7d82 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:40.690748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-27bfe8d7-de2b-47e2-adff-12055b5f7d82 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049948 Aug 24 08:24:40.691303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1167/2270] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:24:41.705918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3ff55554-35bf-48c7-bca5-dc6d0ea9dd01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:41.751082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3ff55554-35bf-48c7-bca5-dc6d0ea9dd01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049457 Aug 24 08:24:41.751649 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1104/2271] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:42.765777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7903f358-804a-4b86-bce2-97161cec5d93 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:42.812213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7903f358-804a-4b86-bce2-97161cec5d93 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050658 Aug 24 08:24:42.812890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1168/2272] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:43.826976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2e5b2f50-81ce-4784-bd4b-854d1652f56a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7df70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:43.873530 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2e5b2f50-81ce-4784-bd4b-854d1652f56a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050677 Aug 24 08:24:43.874099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1105/2273] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:44.887863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6526e254-830e-4b8b-a435-7a4c57c6f2f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db79d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:44.933165 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6526e254-830e-4b8b-a435-7a4c57c6f2f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049449 Aug 24 08:24:44.933720 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1169/2274] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:45.946623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14a9e798-42af-4dad-bff8-c158cdc7b27d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:45.992382 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14a9e798-42af-4dad-bff8-c158cdc7b27d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049945 Aug 24 08:24:45.992988 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1106/2275] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:47.006301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7b108d0c-2e3e-4c29-9d98-7b856bff69e2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:47.051597 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7b108d0c-2e3e-4c29-9d98-7b856bff69e2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049608 Aug 24 08:24:47.052154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1170/2276] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:48.066375 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1bf07df0-c09d-4e57-b684-9271d05cc809 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d189d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:48.112543 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1bf07df0-c09d-4e57-b684-9271d05cc809 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050595 Aug 24 08:24:48.113159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1107/2277] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:49.126321 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-671b48bc-1b25-4cc4-95f3-b855bb87464b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:49.179154 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-671b48bc-1b25-4cc4-95f3-b855bb87464b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056984 Aug 24 08:24:49.179796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1171/2278] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:50.192856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dcaddf56-daaf-415d-9956-e41ac636a2f4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:50.237966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dcaddf56-daaf-415d-9956-e41ac636a2f4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049452 Aug 24 08:24:50.238553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1108/2279] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:51.251914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a9758056-feef-4757-bf78-b7315bdf2689 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:51.297846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a9758056-feef-4757-bf78-b7315bdf2689 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050018 Aug 24 08:24:51.298669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1172/2280] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:52.311708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a374d331-09a4-4948-98d8-e2d7a7a75339 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:52.358385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a374d331-09a4-4948-98d8-e2d7a7a75339 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050898 Aug 24 08:24:52.358948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1109/2281] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:53.372939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2763c694-6837-48bb-b83d-9cbc504d7f2e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:53.417600 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2763c694-6837-48bb-b83d-9cbc504d7f2e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049547 Aug 24 08:24:53.418195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1173/2282] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:54.432109 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a619bce-18cc-43db-a9cd-128551217c42 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:54.477466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a619bce-18cc-43db-a9cd-128551217c42 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049952 Aug 24 08:24:54.478031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1110/2283] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:55.490576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e62ddc22-0b69-4b31-b4e6-203fb074cd1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:55.536258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e62ddc22-0b69-4b31-b4e6-203fb074cd1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049834 Aug 24 08:24:55.536857 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1174/2284] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:56.551809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-93355e32-9e08-4920-95aa-d3879b88928c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:56.609624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-93355e32-9e08-4920-95aa-d3879b88928c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051209 Aug 24 08:24:56.609624 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1111/2285] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:57.621817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c62cc4de-f07f-40d5-b879-0c55cc9c7958 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:57.667885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c62cc4de-f07f-40d5-b879-0c55cc9c7958 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051133 Aug 24 08:24:57.668440 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1175/2286] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:58.682823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83b36f5b-43d6-4e9d-ba82-a574214989eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:58.728353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83b36f5b-43d6-4e9d-ba82-a574214989eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050211 Aug 24 08:24:58.728954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1112/2287] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:24:59.742459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3ea5462d-a60d-4f16-9214-4f2d05c04c63 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:24:59.787973 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3ea5462d-a60d-4f16-9214-4f2d05c04c63 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049737 Aug 24 08:24:59.788535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1176/2288] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:24:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:00.802271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac2081ef-c2ed-4cc4-b1f8-6f8704dbdd6d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d189d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:00.847072 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac2081ef-c2ed-4cc4-b1f8-6f8704dbdd6d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049342 Aug 24 08:25:00.847657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1113/2289] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:01.861166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-59ab9f38-daf3-499e-bebf-6bf5a7791e45 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:01.906785 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-59ab9f38-daf3-499e-bebf-6bf5a7791e45 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049912 Aug 24 08:25:01.907354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1177/2290] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:02.920588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-08682bff-9961-4cd4-8df3-57c30373d462 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cc10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:02.966614 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-08682bff-9961-4cd4-8df3-57c30373d462 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050373 Aug 24 08:25:02.967179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1114/2291] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:25:03.982102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1b378ea6-8bce-498f-bf80-a7ca3fb511d1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:04.028160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1b378ea6-8bce-498f-bf80-a7ca3fb511d1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051089 Aug 24 08:25:04.028738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1178/2292] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:05.043114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-17943a8b-cd8d-43be-8313-a0c81133b8e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f4c0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:05.089016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-17943a8b-cd8d-43be-8313-a0c81133b8e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051022 Aug 24 08:25:05.089574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1115/2293] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:06.103562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-58066530-8aae-48e3-be0a-ba803854f4ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:06.149582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-58066530-8aae-48e3-be0a-ba803854f4ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050556 Aug 24 08:25:06.150173 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1179/2294] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:07.163963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5b5bbf16-3146-4be3-b5f9-237bd3ea62e6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:07.209542 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5b5bbf16-3146-4be3-b5f9-237bd3ea62e6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049949 Aug 24 08:25:07.210100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1116/2295] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:08.224416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0ddbfcec-6ff4-4fd0-822e-0a1d4801055a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568c1eb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:08.271772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0ddbfcec-6ff4-4fd0-822e-0a1d4801055a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051875 Aug 24 08:25:08.272333 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1180/2296] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:09.286363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-836dbd6b-5e2e-4724-a118-cd4298317d2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:09.334312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-836dbd6b-5e2e-4724-a118-cd4298317d2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052325 Aug 24 08:25:09.334890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1117/2297] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:10.348472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fefb694f-ec52-4f5b-81f0-ecc43d386471 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8db80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:10.394389 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fefb694f-ec52-4f5b-81f0-ecc43d386471 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050194 Aug 24 08:25:10.394947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1181/2298] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:11.408638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-abfcbdbc-85e6-4c83-b853-8f831562dd3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4fc10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:11.455035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-abfcbdbc-85e6-4c83-b853-8f831562dd3f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050691 Aug 24 08:25:11.455591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1118/2299] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:12.468980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-acf81f6b-d109-4319-bd61-69c90a27456a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:12.514828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-acf81f6b-d109-4319-bd61-69c90a27456a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050097 Aug 24 08:25:12.515432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1182/2300] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:13.529139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-681e2618-5593-4e35-8014-0b78fb819e51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:13.574980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-681e2618-5593-4e35-8014-0b78fb819e51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050064 Aug 24 08:25:13.575538 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1119/2301] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:14.589148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-82a80359-3f42-44f0-9f1e-7fb16c2df6c2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:14.635721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-82a80359-3f42-44f0-9f1e-7fb16c2df6c2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050845 Aug 24 08:25:14.636283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1183/2302] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:14.946145 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:25:14.946407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:25:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:25:15.650771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f524386-7307-4515-b7ab-26f387add025 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:15.697029 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f524386-7307-4515-b7ab-26f387add025 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050562 Aug 24 08:25:15.697731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1120/2303] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:16.711184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a230d1f5-089e-4464-94f4-cdbd55a61e01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568c1ed30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:16.757497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a230d1f5-089e-4464-94f4-cdbd55a61e01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050595 Aug 24 08:25:16.758049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1184/2304] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:17.772398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-106bd728-3450-4036-8afd-22a15be274b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7133a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:17.819507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-106bd728-3450-4036-8afd-22a15be274b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051440 Aug 24 08:25:17.820070 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1121/2305] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:18.833725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec128d68-e614-40b7-a535-ce87b2f44917 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681d8e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:18.879178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec128d68-e614-40b7-a535-ce87b2f44917 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049689 Aug 24 08:25:18.879766 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1185/2306] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:19.894222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6a23e035-64f7-4154-9558-7cb2cfd02e15 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:19.941823 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6a23e035-64f7-4154-9558-7cb2cfd02e15 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049823 Aug 24 08:25:19.942380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1122/2307] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:20.955480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-faaf779c-b520-4791-acac-a6920a4b575e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:21.001049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-faaf779c-b520-4791-acac-a6920a4b575e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049690 Aug 24 08:25:21.001610 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1186/2308] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:22.016161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f9a5bd3-a6ea-40d2-8ef5-864c0fa3e8a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40c10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:22.062657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f9a5bd3-a6ea-40d2-8ef5-864c0fa3e8a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051116 Aug 24 08:25:22.063218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1123/2309] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:23.083426 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d172ecdc-af1a-42ff-b144-837165698f05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562f138b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:23.129162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d172ecdc-af1a-42ff-b144-837165698f05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049775 Aug 24 08:25:23.129725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1187/2310] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:24.143559 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bc00ce98-b977-4081-88f1-46f9c2b84c66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:24.192966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bc00ce98-b977-4081-88f1-46f9c2b84c66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053554 Aug 24 08:25:24.193535 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1124/2311] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:25.207981 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6204f9af-043b-4cb1-8a13-dd21509db774 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97d30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:25.253695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6204f9af-043b-4cb1-8a13-dd21509db774 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050277 Aug 24 08:25:25.254265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1188/2312] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:26.267168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-88f6537e-2374-49c3-8a4c-7753685506b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:26.324749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-88f6537e-2374-49c3-8a4c-7753685506b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061289 Aug 24 08:25:26.325312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1125/2313] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:27.339848 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e8f1d5ab-8ea5-4a23-ae05-f588b5e5ffad tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:27.403073 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e8f1d5ab-8ea5-4a23-ae05-f588b5e5ffad tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068113 Aug 24 08:25:27.403758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1189/2314] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:28.417265 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-62af0525-efae-4196-b952-a4ac968c671e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:28.455999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:25:28.456210 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:25:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 (ip 10.222.0.26) !!! Aug 24 08:25:28.472553 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-62af0525-efae-4196-b952-a4ac968c671e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059615 Aug 24 08:25:28.473146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1126/2315] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:29.538036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-97d0cabc-954b-42d3-92bd-90724d546c01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:29.583614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-97d0cabc-954b-42d3-92bd-90724d546c01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.100365 Aug 24 08:25:29.584172 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1190/2316] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:30.598371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b91bfe33-01cc-403b-ba7c-109939677e21 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:30.645054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b91bfe33-01cc-403b-ba7c-109939677e21 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.051193 Aug 24 08:25:30.645609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1127/2317] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:31.659238 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-25ac935d-1116-4842-9750-fbcd25e8e53d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d978b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:31.704874 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-25ac935d-1116-4842-9750-fbcd25e8e53d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049730 Aug 24 08:25:31.705436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1191/2318] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:32.718842 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-21916cfe-8fc4-4b57-bfe5-2ecf9f2cb96a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cba3a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:32.764120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-21916cfe-8fc4-4b57-bfe5-2ecf9f2cb96a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049504 Aug 24 08:25:32.764700 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1128/2319] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:33.779162 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-87d2b1a6-504b-41bc-9841-65a297e0b405 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568c1e9d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:33.826432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-87d2b1a6-504b-41bc-9841-65a297e0b405 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052468 Aug 24 08:25:33.826987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1192/2320] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:34.840041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ea84cc0-1de7-420c-a760-1becb601f4aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0c10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:34.905746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ea84cc0-1de7-420c-a760-1becb601f4aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.070181 Aug 24 08:25:34.907326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1129/2321] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:35.920520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4f654516-0f1b-4116-a58a-bd25def540b0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63ee50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:35.969184 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4f654516-0f1b-4116-a58a-bd25def540b0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053117 Aug 24 08:25:35.969755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1193/2322] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:36.982411 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-52ce46ba-a172-4f37-bf57-7656e3eba1d8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cba5e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:37.044205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-52ce46ba-a172-4f37-bf57-7656e3eba1d8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065993 Aug 24 08:25:37.044811 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1130/2323] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:38.060211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b8e37c95-d309-4457-b1bd-fe76a316cb6f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:38.115871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b8e37c95-d309-4457-b1bd-fe76a316cb6f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060161 Aug 24 08:25:38.116436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1194/2324] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:39.130839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a56803fc-c754-41f8-ad79-f5157452a08b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40b80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:39.188791 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a56803fc-c754-41f8-ad79-f5157452a08b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062273 Aug 24 08:25:39.189356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1131/2325] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:40.202825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1e1a17e0-46ab-4bae-9ea7-bf7d34793177 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db74c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:40.262489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1e1a17e0-46ab-4bae-9ea7-bf7d34793177 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063942 Aug 24 08:25:40.263036 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1195/2326] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:41.275673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c2e82cf-419d-400e-af3b-34843e060dcf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:41.329311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3c2e82cf-419d-400e-af3b-34843e060dcf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057989 Aug 24 08:25:41.329879 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1132/2327] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:42.344511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9b311bd9-9747-4a54-9ea2-f2b1571b0a4f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568c1ed30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:42.400160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9b311bd9-9747-4a54-9ea2-f2b1571b0a4f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059763 Aug 24 08:25:42.400744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1196/2328] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:43.415075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-063baaab-80bb-462d-89b9-c240e182ba59 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c405e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:43.470815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-063baaab-80bb-462d-89b9-c240e182ba59 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060533 Aug 24 08:25:43.471402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1133/2329] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:44.486067 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b2f63e2f-4cf9-4549-9991-eb539912af50 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:44.553871 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b2f63e2f-4cf9-4549-9991-eb539912af50 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.072201 Aug 24 08:25:44.554514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1197/2330] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:45.568773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f32587a7-fee2-47d4-858f-2e87c7edbd99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:45.654951 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f32587a7-fee2-47d4-858f-2e87c7edbd99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.090413 Aug 24 08:25:45.655528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1134/2331] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:46.669705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-97f9e201-e97c-4079-8964-495058f66d1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:46.724181 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-97f9e201-e97c-4079-8964-495058f66d1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059538 Aug 24 08:25:46.724764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1198/2332] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:47.739000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-225acd81-7f2a-45d2-b420-1439297398e8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:47.794812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-225acd81-7f2a-45d2-b420-1439297398e8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059997 Aug 24 08:25:47.795378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1135/2333] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:48.809725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f9f3abb3-984c-4d01-9d73-8e713660fd10 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6754c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:48.863615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f9f3abb3-984c-4d01-9d73-8e713660fd10 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058824 Aug 24 08:25:48.864183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1199/2334] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:49.878314 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-497e165d-4270-4238-b2ac-9943562dbc68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:49.944028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-497e165d-4270-4238-b2ac-9943562dbc68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060819 Aug 24 08:25:49.944028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1136/2335] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:50.956245 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9f1854e1-fdcf-4393-8530-5fd9ece9b949 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d989d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:51.012601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9f1854e1-fdcf-4393-8530-5fd9ece9b949 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060627 Aug 24 08:25:51.013265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1200/2336] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:52.027747 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a9a225d-d497-4a19-bdc8-5675c62afd23 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:52.082661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a9a225d-d497-4a19-bdc8-5675c62afd23 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059994 Aug 24 08:25:52.083516 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1137/2337] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:53.097359 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-99118a29-9e51-4189-ac2d-59fa5da1aefd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db79d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:53.152508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-99118a29-9e51-4189-ac2d-59fa5da1aefd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059412 Aug 24 08:25:53.153097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1201/2338] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:54.167513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2416354e-221e-4c58-ace7-9afab21a9a52 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:54.225529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2416354e-221e-4c58-ace7-9afab21a9a52 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063229 Aug 24 08:25:54.226104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1138/2339] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:55.247631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c9c742f1-0c49-4624-89a4-0b3175cf7a49 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:55.292501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c9c742f1-0c49-4624-89a4-0b3175cf7a49 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.049130 Aug 24 08:25:55.293208 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1202/2340] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:56.307054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eb229c66-910e-45f3-babe-32ff67d5dc66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c400d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:56.365564 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eb229c66-910e-45f3-babe-32ff67d5dc66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062802 Aug 24 08:25:56.366122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1139/2341] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:57.379546 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-067c1137-d5da-49bc-ae9a-c3dd87ea5273 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f1f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:57.437936 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-067c1137-d5da-49bc-ae9a-c3dd87ea5273 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062630 Aug 24 08:25:57.438510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1203/2342] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:58.452558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0a7a22b-d3a5-4e2d-8950-237f3e5885ac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:58.509339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0a7a22b-d3a5-4e2d-8950-237f3e5885ac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060957 Aug 24 08:25:58.509905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1140/2343] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:25:59.523091 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f7e37eda-59fc-4994-8f04-c02c6848d2a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:25:59.581205 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f7e37eda-59fc-4994-8f04-c02c6848d2a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062189 Aug 24 08:25:59.581792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1204/2344] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:25:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:00.596137 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5f44c21f-303e-4d6c-8287-612534cd3961 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:00.652809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5f44c21f-303e-4d6c-8287-612534cd3961 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061355 Aug 24 08:26:00.653453 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1141/2345] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:01.667586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2964b23f-b56f-4b82-a215-afab5d4930e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:01.722062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2964b23f-b56f-4b82-a215-afab5d4930e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059139 Aug 24 08:26:01.722626 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1205/2346] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:02.735513 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f67023b-9f1e-4676-8b74-7adec9b97a52 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:02.793117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f67023b-9f1e-4676-8b74-7adec9b97a52 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061679 Aug 24 08:26:02.793676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1142/2347] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:03.807304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1f8d6368-9729-4194-8453-497c3aa9c7c7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:03.866777 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1f8d6368-9729-4194-8453-497c3aa9c7c7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064375 Aug 24 08:26:03.868140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1206/2348] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:04.881209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a74f94e9-868f-4319-b8a4-379c7d180513 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4fd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:04.934579 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a74f94e9-868f-4319-b8a4-379c7d180513 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057637 Aug 24 08:26:04.935142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1143/2349] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:05.948800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b56f82d2-b1c7-40a5-afeb-f00a02d68d0e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:06.011025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b56f82d2-b1c7-40a5-afeb-f00a02d68d0e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066668 Aug 24 08:26:06.011588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1207/2350] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:07.036187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c359ddde-c52f-4f2c-8682-83db4213c2b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:07.082323 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c359ddde-c52f-4f2c-8682-83db4213c2b6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061477 Aug 24 08:26:07.082886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1144/2351] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:08.097349 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b3c72199-c3cd-4737-85df-0b71bc156e35 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:08.171551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b3c72199-c3cd-4737-85df-0b71bc156e35 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.078757 Aug 24 08:26:08.172399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1208/2352] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:09.186200 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1da5fb4b-fe06-441a-aa8b-53dc76f92262 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:09.241099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1da5fb4b-fe06-441a-aa8b-53dc76f92262 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059050 Aug 24 08:26:09.242139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1145/2353] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:10.255616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-706f3d40-bd06-43ea-b5ef-be49cd88357d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:10.314394 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-706f3d40-bd06-43ea-b5ef-be49cd88357d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063034 Aug 24 08:26:10.314967 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1209/2354] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:11.328310 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-678a8a98-148a-4d75-b5fa-1c61e93cf9ed tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b8b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:11.383943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-678a8a98-148a-4d75-b5fa-1c61e93cf9ed tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059834 Aug 24 08:26:11.384612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1146/2355] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:12.398599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ec669a1c-64b1-47db-ba4d-4d24a1a9a2fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:12.455762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ec669a1c-64b1-47db-ba4d-4d24a1a9a2fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062003 Aug 24 08:26:12.456324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1210/2356] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:13.470363 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ddeb96f0-a2a4-40e0-a515-bb50d1553a51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:13.527016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ddeb96f0-a2a4-40e0-a515-bb50d1553a51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060747 Aug 24 08:26:13.527576 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1147/2357] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:14.541727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-21f0fce0-8b31-43c8-b0f7-5c252fb0c576 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:14.598097 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-21f0fce0-8b31-43c8-b0f7-5c252fb0c576 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061506 Aug 24 08:26:14.598655 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1211/2358] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:15.612547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8bf33fd-e8c8-4bcf-8f99-d668c49cc79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:15.666550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8bf33fd-e8c8-4bcf-8f99-d668c49cc79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058215 Aug 24 08:26:15.667107 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1148/2359] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:16.680133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4c46d4bd-bad3-4cb1-8bbe-5bca1bc87084 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:16.737054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4c46d4bd-bad3-4cb1-8bbe-5bca1bc87084 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060367 Aug 24 08:26:16.737638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1212/2360] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:17.752419 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-41473e63-90bb-4f27-8ab0-d2243d27e35d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4fa60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:17.808431 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-41473e63-90bb-4f27-8ab0-d2243d27e35d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060246 Aug 24 08:26:17.809030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1149/2361] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:18.823241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4669c423-77bd-4da9-a75a-cbaf9ccb8258 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfa60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:18.882896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4669c423-77bd-4da9-a75a-cbaf9ccb8258 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064180 Aug 24 08:26:18.883604 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1213/2362] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:19.897246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bfa98e13-4863-49b6-b1a2-b2834b09615b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:19.961317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bfa98e13-4863-49b6-b1a2-b2834b09615b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068287 Aug 24 08:26:19.961918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1150/2363] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:20.975283 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-62a20e21-a3cf-44fa-a674-c993f818fd2d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:21.026005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-62a20e21-a3cf-44fa-a674-c993f818fd2d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054842 Aug 24 08:26:21.026570 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1214/2364] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:22.044929 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-439c51a7-c178-48ce-a05a-8b2a72f2cf60 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:22.097592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-439c51a7-c178-48ce-a05a-8b2a72f2cf60 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060357 Aug 24 08:26:22.098165 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1151/2365] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:23.113004 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-576d6514-7b64-4950-a5fd-1ab6feaac9e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d9d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:23.167853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-576d6514-7b64-4950-a5fd-1ab6feaac9e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059115 Aug 24 08:26:23.168410 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1215/2366] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:24.181657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46e96a2d-6f6c-4298-9de4-d7ef569a40c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c403a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:24.238211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46e96a2d-6f6c-4298-9de4-d7ef569a40c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060233 Aug 24 08:26:24.244350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1152/2367] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:25.255118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-54a8b623-528f-4292-8d39-949934f1ff3d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:25.319432 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-54a8b623-528f-4292-8d39-949934f1ff3d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068680 Aug 24 08:26:25.320045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1216/2368] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:26.333677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9972775e-7836-4436-b2ea-e2c02302573d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:26.385290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9972775e-7836-4436-b2ea-e2c02302573d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.055749 Aug 24 08:26:26.385873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1153/2369] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:27.398865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7650d220-de29-4fba-9ab1-5b75f560431d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:27.452688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7650d220-de29-4fba-9ab1-5b75f560431d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058267 Aug 24 08:26:27.453279 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1217/2370] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:28.467541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-499e9186-93cf-40e4-8108-047016f21eba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c400d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:28.526250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-499e9186-93cf-40e4-8108-047016f21eba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062933 Aug 24 08:26:28.526834 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1154/2371] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:29.540182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-808609b1-9831-4569-a5c3-89625d1d2802 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98b80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:29.596308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-808609b1-9831-4569-a5c3-89625d1d2802 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060850 Aug 24 08:26:29.596999 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1218/2372] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:30.610933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a27ea6d0-92e3-4eda-bead-80eecec73fba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:30.671232 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a27ea6d0-92e3-4eda-bead-80eecec73fba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064492 Aug 24 08:26:30.672290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1155/2373] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:30.750826 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c605cafe-34f5-44d3-83db-9e8d02896979 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfa60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:30.797584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-c605cafe-34f5-44d3-83db-9e8d02896979 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c605cafe-34f5-44d3-83db-9e8d02896979 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Request method failure captured: Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: DELETE /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 HTTP/1.1 Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBd9N_36ocUyMAXRErVpWq9vBk_Lh_s8IE_45ftWKoEj42_a_31Xf6ru8VI28v7qc4y60C1oYQD0cL2t3xgk8KdO83vxfIsHg44-VaVjKZTsXIm5Bk31J6G9qTKgz0Y3xTciRPKEKcMdxoavINn2wKYs0t218EeEbaimSbeHx3r_nlJM Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: 0ed82d8ed9a4431f8528213ac5e91c7e Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-646704247 Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:26:30.799643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ed82d8ed9a4431f8528213ac5e91c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ed82d8ed9a4431f8528213ac5e91c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed82d8ed9a4431f8528213ac5e91c7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed82d8ed9a4431f8528213ac5e91c7e"}]}] Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-646704247 Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: 0ed82d8ed9a4431f8528213ac5e91c7e Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-646704247 Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesSnapshotsTestJSON-646704247-project Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 5fb0b775f9ee4a44a736346a173bdd49 Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-646704247-project Aug 24 08:26:30.801578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': '89e3ad92-bf21-4703-9688-35c9e4486098'} Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:26:30.802473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:26:30.803975 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.805620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 138, in delete Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:26:30.807033 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:26:30.808480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:26:30.808480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:26:30.808480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) Aug 24 08:26:30.808480 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:26:30.809556 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c605cafe-34f5-44d3-83db-9e8d02896979 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-52a61260-111d-4f92-a48f-37e0d18f82dd) {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:26:30.810414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c605cafe-34f5-44d3-83db-9e8d02896979 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 400 len: 397 microversion: 2.1 time: 0.063786 Aug 24 08:26:30.810952 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1219/2374] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 24 08:26:30 2022] DELETE /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 397 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:26:30.819039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac2b3e20-a517-4ad6-8fb8-4cad72adeeea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7139d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:30.870475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac2b3e20-a517-4ad6-8fb8-4cad72adeeea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052343 Aug 24 08:26:30.870475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1156/2375] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:31.882324 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-049e811e-9931-4e21-a4cc-a90345a9f4f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:31.930384 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-049e811e-9931-4e21-a4cc-a90345a9f4f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052217 Aug 24 08:26:31.930971 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1220/2376] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:32.944916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03764aa7-51f0-4385-933b-73ee87c5dac7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cba5e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:32.995958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03764aa7-51f0-4385-933b-73ee87c5dac7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054948 Aug 24 08:26:32.996555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1157/2377] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:34.010237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d0fe6cbf-bfab-415a-9904-31b7266b31f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:34.056422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d0fe6cbf-bfab-415a-9904-31b7266b31f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050753 Aug 24 08:26:34.057738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1221/2378] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:35.071809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-49de898d-937d-48d5-9f0b-f726400c693c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:35.134260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-49de898d-937d-48d5-9f0b-f726400c693c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066560 Aug 24 08:26:35.136904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1158/2379] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:36.152130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3e4182c0-6943-4c94-95e3-3a3445b2b05e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:36.216102 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3e4182c0-6943-4c94-95e3-3a3445b2b05e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.068779 Aug 24 08:26:36.220776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1222/2380] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:37.232934 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-97164ffc-cbbd-4a91-83b6-6f12fea515a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:37.285824 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-97164ffc-cbbd-4a91-83b6-6f12fea515a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059758 Aug 24 08:26:37.286469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1159/2381] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:38.300473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1f94e73d-0865-4b90-a910-48b0c5ed905c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b700700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:38.378136 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1f94e73d-0865-4b90-a910-48b0c5ed905c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.081882 Aug 24 08:26:38.380277 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1223/2382] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:39.393964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-459d9bd9-5e15-4450-b1a8-40a179e202a4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:39.451081 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-459d9bd9-5e15-4450-b1a8-40a179e202a4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060898 Aug 24 08:26:39.451643 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1160/2383] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:40.466021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cffabbf2-f75c-4352-aa04-9e12f1c97c01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:40.517500 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cffabbf2-f75c-4352-aa04-9e12f1c97c01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056670 Aug 24 08:26:40.518212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1224/2384] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:41.534400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1503ce0f-cbfd-49bd-8493-3c40fa243ffe tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c7d0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:41.588372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1503ce0f-cbfd-49bd-8493-3c40fa243ffe tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060329 Aug 24 08:26:41.589308 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1161/2385] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:42.602572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-98925592-a560-49a3-a255-e99f06a7feaf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45681bfa60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:42.675677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-98925592-a560-49a3-a255-e99f06a7feaf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.077287 Aug 24 08:26:42.676250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1225/2386] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:43.695371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3491c23a-f81c-469f-b285-72dca7ccaee6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:43.739494 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3491c23a-f81c-469f-b285-72dca7ccaee6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054160 Aug 24 08:26:43.740060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1162/2387] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:44.753864 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0a118667-eba9-4b22-a5d4-4c96c051b34b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562f138b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:44.804928 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0a118667-eba9-4b22-a5d4-4c96c051b34b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.054852 Aug 24 08:26:44.806084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1226/2388] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:45.819242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a3b73297-6110-4cab-8987-25b45be36d53 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:45.897871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a3b73297-6110-4cab-8987-25b45be36d53 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.082222 Aug 24 08:26:45.898587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1163/2389] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:46.914396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-29032117-7391-495a-b067-5ebb6e342e56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d430>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:47.062613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-29032117-7391-495a-b067-5ebb6e342e56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.153039 Aug 24 08:26:47.068910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1227/2390] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:48.076552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-766fb000-e783-40ed-a251-efdebb4e0642 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:48.167174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-766fb000-e783-40ed-a251-efdebb4e0642 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.095498 Aug 24 08:26:48.168035 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1164/2391] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:49.181623 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-596b33af-b0d2-4019-8be5-36c655d259f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:49.267910 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-596b33af-b0d2-4019-8be5-36c655d259f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.090364 Aug 24 08:26:49.268728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1228/2392] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:50.286572 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5cc1332d-ac76-40e8-9245-f95c5b2fe2e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:50.396914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5cc1332d-ac76-40e8-9245-f95c5b2fe2e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.118887 Aug 24 08:26:50.397556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1165/2393] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:51.410195 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6ea924a2-8f6c-4ca3-a956-7194ba3e29d9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:51.470922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6ea924a2-8f6c-4ca3-a956-7194ba3e29d9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064518 Aug 24 08:26:51.471796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1229/2394] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:52.484999 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a6e7f1c-5a92-4fe4-8bae-778252479a66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:52.562287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a6e7f1c-5a92-4fe4-8bae-778252479a66 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.076326 Aug 24 08:26:52.562287 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1166/2395] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:53.574669 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-57ab1986-be1a-4b1a-b4b2-4a4a311d6e47 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:53.644170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-57ab1986-be1a-4b1a-b4b2-4a4a311d6e47 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.073680 Aug 24 08:26:53.644314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1230/2396] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:54.658293 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e890f313-2657-42e6-981f-73b9ecca0bb6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71f1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:54.724519 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e890f313-2657-42e6-981f-73b9ecca0bb6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.070039 Aug 24 08:26:54.725420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1167/2397] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:55.348242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-332090f9-bf40-451f-af36-3f2eedef2425 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'create', calling method: .version_select at 0x7f4562db74c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1265034099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubGun40i0QzCSb4Xx1Fkbwq+kFPODrvRwBqSi98+x6Ipe1fGBoeVIMXZ9AHrUebAOrm4gspCHjQRc05gI1b0vU+J//90UXJ78aUTqBpEKyMQQujkhFJ1UjpPm6xkg72g=="}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:26:55.364226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-332090f9-bf40-451f-af36-3f2eedef2425 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Getting quotas for project 19a004d608f2454cb5e9e65eef5ed740. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:26:55.368101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-332090f9-bf40-451f-af36-3f2eedef2425 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Getting quotas for user b5600f62677d437ead57459e3cf75e41 and project 19a004d608f2454cb5e9e65eef5ed740. Resources: {'key_pairs'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:26:55.447865 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-332090f9-bf40-451f-af36-3f2eedef2425 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.104055 Aug 24 08:26:55.448377 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1231/2398] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 24 08:26:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:55.499467 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-934810445", "imageRef": "54e773dc-8d66-44bb-8b40-163a6e507718", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1265034099", "networks": [{"uuid": "8cac0a04-7c7c-4e4a-9be2-53aa29932362"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:26:55.550812 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] validate_networks() for [('8cac0a04-7c7c-4e4a-9be2-53aa29932362', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:26:55.739986 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3a3f31f4-a018-4751-83f0-1bfdcf3051fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:55.793684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3a3f31f4-a018-4751-83f0-1bfdcf3051fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057492 Aug 24 08:26:55.794337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1232/2399] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:26:56.029248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:26:56.029740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:26:56.030127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:26:56.030562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:26:56.030969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:26:56.039713 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:26:56.040188 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:26:56.040622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:26:56.041373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:26:56.041830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:26:56.042249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:26:56.060122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Getting quotas for project 19a004d608f2454cb5e9e65eef5ed740. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:26:56.064119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Getting quotas for user b5600f62677d437ead57459e3cf75e41 and project 19a004d608f2454cb5e9e65eef5ed740. Resources: {'instances', 'cores', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:26:56.074966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:26:56.077187 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='54e773dc-8d66-44bb-8b40-163a6e507718',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:26:56.222268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0c5a05f-01ce-4d0c-a556-d1408d780392 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727122 Aug 24 08:26:56.222939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1168/2400] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 08:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:26:56.234380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0dc09f33-ee73-490e-90cd-2e8628665d71 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:56.235016 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0dc09f33-ee73-490e-90cd-2e8628665d71 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:26:56.286988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0dc09f33-ee73-490e-90cd-2e8628665d71 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:26:56.294592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0dc09f33-ee73-490e-90cd-2e8628665d71 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1258 microversion: 2.1 time: 0.064749 Aug 24 08:26:56.295161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1233/2401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:26:56 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:26:56.807526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1085afe9-6c4a-49ca-bbee-50c005ae99f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd03a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:56.868028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1085afe9-6c4a-49ca-bbee-50c005ae99f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059405 Aug 24 08:26:56.868028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1169/2402] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:57.315105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-63a7658b-912e-4995-be82-b7135049ef80 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:57.315735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-63a7658b-912e-4995-be82-b7135049ef80 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:26:57.371582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-63a7658b-912e-4995-be82-b7135049ef80 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:26:57.378671 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-63a7658b-912e-4995-be82-b7135049ef80 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1258 microversion: 2.1 time: 0.067366 Aug 24 08:26:57.379231 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1234/2403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:26:57 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:26:57.879650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39f4d901-54d0-4f8c-84eb-a7a286713895 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18af0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:57.935825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39f4d901-54d0-4f8c-84eb-a7a286713895 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060296 Aug 24 08:26:57.936397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1170/2404] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:58.398613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1ca599d2-46ad-49cf-ad1b-4b5a02a15ef6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:58.399269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-1ca599d2-46ad-49cf-ad1b-4b5a02a15ef6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:26:58.453186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-1ca599d2-46ad-49cf-ad1b-4b5a02a15ef6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:26:58.460112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1ca599d2-46ad-49cf-ad1b-4b5a02a15ef6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1258 microversion: 2.1 time: 0.065382 Aug 24 08:26:58.460704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1235/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:26:58 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:26:58.950383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-400db252-85f2-42eb-bc21-a4e9dc06c7c2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b73b8b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:59.007239 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-400db252-85f2-42eb-bc21-a4e9dc06c7c2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061666 Aug 24 08:26:59.007810 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1171/2406] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:26:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:26:59.480694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2403c92d-ff08-4401-8818-c2358cdf96ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:26:59.481308 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2403c92d-ff08-4401-8818-c2358cdf96ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:26:59.534221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2403c92d-ff08-4401-8818-c2358cdf96ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:26:59.541081 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2403c92d-ff08-4401-8818-c2358cdf96ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1258 microversion: 2.1 time: 0.064332 Aug 24 08:26:59.541638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1236/2407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:26:59 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:00.022774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-66aa4833-6cd1-47d2-a83b-8c3d3b9eba1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:00.087238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-66aa4833-6cd1-47d2-a83b-8c3d3b9eba1b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.069362 Aug 24 08:27:00.094152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1172/2408] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:00.561640 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:00.562255 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:00.568830 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:00.569307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:00.569738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:00.570419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:00.570866 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:00.571284 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:00.632159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:00.639820 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49de19a4-b2b4-4bc9-9dd4-40f8449a4c99 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1262 microversion: 2.1 time: 0.082101 Aug 24 08:27:00.640381 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1237/2409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:00 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:01.100932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-66786089-1bdf-4e81-add7-1c9eb99d5d2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:01.157085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-66786089-1bdf-4e81-add7-1c9eb99d5d2b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060221 Aug 24 08:27:01.157660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1173/2410] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:01.660731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:01.661338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:01.668267 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:01.668759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:01.669192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:01.669868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:01.670314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:01.670728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:01.733591 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:01.741490 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fa13be70-ff61-496d-b817-c5e52b2c732a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1262 microversion: 2.1 time: 0.084636 Aug 24 08:27:01.742080 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1238/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:01 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:02.172034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b5799bc-9637-4a7a-9201-8906e1c5ba26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c740d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:02.229839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b5799bc-9637-4a7a-9201-8906e1c5ba26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062805 Aug 24 08:27:02.232786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1174/2412] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:02.762456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:02.763740 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:02.770132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:02.770614 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:02.771078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:02.771759 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:02.772201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:02.772613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:02.848963 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:02.856924 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cc391445-1683-4734-9ba5-9b40030dc887 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1316 microversion: 2.1 time: 0.098329 Aug 24 08:27:02.857504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1239/2413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:02 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1316 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:03.196662 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:27:03.196991 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:27:03.244069 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4563f4e7-dc91-4baf-bd65-09232d1868a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:03.364571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4563f4e7-dc91-4baf-bd65-09232d1868a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.124859 Aug 24 08:27:03.371250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1175/2414] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:03.876816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:03.877431 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:03.888674 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:03.889462 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:03.890133 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:03.891045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:03.891816 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:03.892588 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:04.095916 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:04.105551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e74752f-879d-424f-8d43-cf30d84f5fd6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.232599 Aug 24 08:27:04.113175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1240/2415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:03 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:04.380731 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-825fbf7b-5c87-464c-ac1b-1150b105188b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4563733310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:04.446197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-825fbf7b-5c87-464c-ac1b-1150b105188b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.070673 Aug 24 08:27:04.454869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1176/2416] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:04.698015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:27:04.717723 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:04.719141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:04.720219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:04.739112 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] Creating event network-changed:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:27:04.742582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] [376fbd59-bb6b-4529-a149-cff867cb4176] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:27:05.148268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:05.149288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:05.156361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:05.156870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:05.157295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:05.157983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:05.158455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:05.159066 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:05.289815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:05.301185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da880cb2-cb1d-4d15-817b-f2df78efca0a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.156460 Aug 24 08:27:05.302896 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1177/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:05 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:27:05.461979 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9d64fa4-8844-45e2-8d5e-20433a6cdab2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cd0160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:05.516033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9d64fa4-8844-45e2-8d5e-20433a6cdab2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057722 Aug 24 08:27:05.516600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1178/2418] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:27:05.750823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] [376fbd59-bb6b-4529-a149-cff867cb4176] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37974. Aug 24 08:27:05.754540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-0a12e219-809b-4289-82cc-348be11a2128 req-b0942e38-111d-49f4-a5b7-d6dd7171b7b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.284385 Aug 24 08:27:05.755142 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1241/2419] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:06.320960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:06.320960 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:06.326846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:06.327580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:06.335894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:06.336466 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:06.336963 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:06.338037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:06.338563 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:06.339110 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:06.503527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:06.513550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bbe7ff01-45b1-44b7-a798-9daefd17a9dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.193865 Aug 24 08:27:06.514286 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1179/2420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:06 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:06.537548 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c753156a-b9fb-4edf-8d94-fb5db94b8950 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:06.613822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c753156a-b9fb-4edf-8d94-fb5db94b8950 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.082648 Aug 24 08:27:06.614425 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1242/2421] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:27:07.540887 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:07.541495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:07.548995 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:07.549469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:07.549905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:07.550584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:07.551055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:07.551472 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:07.629472 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0044a5f0-f020-4124-9a00-d8fb045281d2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:07.725804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0044a5f0-f020-4124-9a00-d8fb045281d2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.100671 Aug 24 08:27:07.726362 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1243/2422] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:07.729872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:07.740906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c73e59ad-174d-440a-a68d-cd8569e3f52a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.204121 Aug 24 08:27:07.742083 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1180/2423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:07 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:08.739828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4955251d-c146-4b98-a5e0-d0da396dcef6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:08.765427 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:08.766600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:08.774175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:08.774650 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:08.775075 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:08.775796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:08.776233 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:08.776665 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:08.824781 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4955251d-c146-4b98-a5e0-d0da396dcef6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.088956 Aug 24 08:27:08.825424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1244/2424] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:08.932948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:08.940625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-05afb44e-6789-4d07-8cbc-a7eda5d0efad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.181525 Aug 24 08:27:08.941201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1181/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:08 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:09.836007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=12 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:09.841296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-652e6302-a4f4-444c-a8df-8e14c697a80f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6750d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:09.894695 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-652e6302-a4f4-444c-a8df-8e14c697a80f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059425 Aug 24 08:27:09.895764 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1245/2426] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:09.962023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:09.965914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:09.974074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:09.974816 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:09.975350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:09.976155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:09.976743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:09.977260 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:10.115246 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:10.123753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf11d8f1-408a-4f93-a7e5-cf9eef7ce60b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.165733 Aug 24 08:27:10.124305 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1182/2427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:09 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:10.909211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eea5e353-aa85-4035-9bb8-398094707713 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:10.979545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eea5e353-aa85-4035-9bb8-398094707713 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.073986 Aug 24 08:27:10.980214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1246/2428] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:11.144451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:11.145045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:11.151426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:11.151902 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:11.152333 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:11.153317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:11.154141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:11.154638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:11.310792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:11.319877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3d5034fc-32cc-47a4-b2ae-7c5595b48fa5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.179224 Aug 24 08:27:11.320458 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1183/2429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:11 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:11.993336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dbb12112-d6d2-41fd-bbda-21831bb4742e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d839d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:12.047334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dbb12112-d6d2-41fd-bbda-21831bb4742e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057596 Aug 24 08:27:12.047920 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1247/2430] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:12.341841 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:12.342596 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:12.349249 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:12.349793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:12.350288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:12.351036 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:12.351608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:12.352082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:12.719352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:12.727385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-964678a7-20ad-46dd-bb44-e6f378acf965 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.389837 Aug 24 08:27:12.727952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1184/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:12 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:13.027574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:27:13.027741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:27:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:27:13.061380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e853ef65-0b82-4ac1-8573-9ea4c4a7c934 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:13.110323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e853ef65-0b82-4ac1-8573-9ea4c4a7c934 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053420 Aug 24 08:27:13.110889 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1248/2432] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:13.748889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:13.749417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:13.755651 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:13.756114 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:13.756540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:13.757238 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:13.757674 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:13.758085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:13.886450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:13.894918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-879b2997-599f-4bdd-afa0-8b1e1ac0d147 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.150217 Aug 24 08:27:13.895473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1185/2433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:13 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:14.135003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-09459ea2-56ab-4f44-b37a-dbad9e576be9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83d30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:14.205652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-09459ea2-56ab-4f44-b37a-dbad9e576be9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.074743 Aug 24 08:27:14.206338 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1249/2434] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:14.915657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:14.916215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:14.923447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:14.923919 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:14.924345 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:14.925042 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:14.925481 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:14.925892 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:15.055343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:15.064185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bea23499-ca94-4735-a7fd-dbe75ff2da91 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.152367 Aug 24 08:27:15.064764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1186/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:14 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:15.216586 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:15.221802 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=26 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:15.222525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c12c6c44-9de4-4278-b6c5-d603fd088535 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:15.269334 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c12c6c44-9de4-4278-b6c5-d603fd088535 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053885 Aug 24 08:27:15.269899 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1250/2436] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:16.085028 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:16.085631 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:16.092119 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:16.092589 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:16.093046 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:16.093733 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:16.094179 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:16.094605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:16.239840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:16.239840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d3e1367b-d73c-43fe-9b89-9135848b12cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.149774 Aug 24 08:27:16.239840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1187/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:16 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:16.284758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b4e64151-3597-4f82-86aa-4a96faef637e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:16.333101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b4e64151-3597-4f82-86aa-4a96faef637e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.053205 Aug 24 08:27:16.333668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1251/2438] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:17.253172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:17.253802 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:17.260487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:17.261071 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:17.261569 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:17.262942 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:17.263456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:17.263814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:17.346488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-393b1bca-4313-48da-a8c8-1b9d0bd0459e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6750d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:17.401343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:17.408962 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2bc54903-a8ee-48bc-83d6-148e813b0728 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.159680 Aug 24 08:27:17.409721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1188/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:17 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:17.410731 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-393b1bca-4313-48da-a8c8-1b9d0bd0459e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067780 Aug 24 08:27:17.411272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1252/2440] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:18.424820 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-40e92ab6-2b0b-47ae-b6d6-1dce0f3efaf9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:18.429027 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:18.429817 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:18.438054 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:18.438620 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:18.439139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:18.439898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:18.440446 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:18.440959 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:18.487983 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-40e92ab6-2b0b-47ae-b6d6-1dce0f3efaf9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067095 Aug 24 08:27:18.494869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1189/2441] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:18.577273 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:18.584854 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-054d8b31-8344-4546-be9a-15533aa440da tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.159644 Aug 24 08:27:18.585412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1253/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:18 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:27:18.941826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:27:18.951739 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:18.952266 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:18.952722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:18.965748 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] Creating event network-vif-plugged:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:27:18.968634 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR oslo.messaging._drivers.impl_rabbit [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] [982fca8c-522f-4ed1-82c4-3d67fb7ac034] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:27:19.502077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e8542fa8-8667-46e9-a950-c83c223e0450 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:19.555617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e8542fa8-8667-46e9-a950-c83c223e0450 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.057231 Aug 24 08:27:19.556189 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1254/2443] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:27:19.605386 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:19.606487 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:19.612335 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:19.612845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:19.613269 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:19.613937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:19.614375 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:19.614784 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:19.743352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:19.751459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-478b3414-b466-48d0-aa4b-6ffe45baa981 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.149796 Aug 24 08:27:19.752015 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1255/2444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:19 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:27:19.975784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] [982fca8c-522f-4ed1-82c4-3d67fb7ac034] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38140. Aug 24 08:27:19.978923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-f7979d8c-7f99-47db-b2fe-8a377c2b5a18 req-2421c38e-392b-498e-8937-48f344f629a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.098558 Aug 24 08:27:19.979521 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1190/2445] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:20.570150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-06313ba2-3f4e-4dd6-9954-01bf1d72ff89 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:20.628974 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-06313ba2-3f4e-4dd6-9954-01bf1d72ff89 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062514 Aug 24 08:27:20.629545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1256/2446] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:20.772987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:20.773684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:20.775609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:20.781203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:20.781678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:20.782112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:20.782795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:20.783247 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:20.783668 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:20.912317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:20.919967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b2f9d09-d86b-41a1-855a-0a5f6432739c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1358 microversion: 2.1 time: 0.151678 Aug 24 08:27:20.920528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1191/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:20 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:21.643323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e961eeb3-4e5b-4c16-8775-a8a1e5229e5e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:21.699624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e961eeb3-4e5b-4c16-8775-a8a1e5229e5e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060392 Aug 24 08:27:21.700215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1257/2448] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:21.940197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:21.940829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:21.947173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:21.947641 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:21.948063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:21.948766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:21.949206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:21.950261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.081795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:22.089720 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f4b42f68-a878-48e8-8dfe-00d08f0c4b72 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1548 microversion: 2.1 time: 0.153290 Aug 24 08:27:22.091161 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1192/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:21 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:22.110550 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:22.111155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:22.117958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.118186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.118611 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.119285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.119728 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.120144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.248459 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:22.256106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f80d8c55-ebdd-42fb-aebe-8e8ee3fb8f11 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1548 microversion: 2.1 time: 0.149336 Aug 24 08:27:22.256715 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1258/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:22 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:22.276104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:22.281685 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:22.282446 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Searching by: {'deleted': False, 'project_id': '19a004d608f2454cb5e9e65eef5ed740'} {{(pid=132892) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 08:27:22.289117 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.289580 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.290003 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.290707 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.291148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.291557 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.381721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.multi_cell_list [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132892) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 08:27:22.476024 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-01b7d98a-71ca-4792-85e0-ef10bc7b39cf tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203573 Aug 24 08:27:22.476512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1193/2451] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Aug 24 08:27:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:22.490235 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:22.490873 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:27:22.496757 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.497226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.497652 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.498323 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:27:22.498797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:27:22.499214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:27:22.626077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:27:22.633661 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e8ea4286-c1ba-471e-8aed-570b8723a7b3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1548 microversion: 2.1 time: 0.147309 Aug 24 08:27:22.634226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1259/2452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:27:22 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:27:22.712985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c89fcaa6-6d66-4bf0-b2b3-97a959ca4d62 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:23.275749 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c89fcaa6-6d66-4bf0-b2b3-97a959ca4d62 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.566387 Aug 24 08:27:23.284546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1194/2453] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:24.289969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-65389c24-6a33-4df0-98f7-f603ad726c5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:24.348351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-65389c24-6a33-4df0-98f7-f603ad726c5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062258 Aug 24 08:27:24.348960 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1260/2454] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:25.363350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d98864c-2b41-4fcc-96c8-26630e642e22 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:25.419507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d98864c-2b41-4fcc-96c8-26630e642e22 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060462 Aug 24 08:27:25.420078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1195/2455] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:26.434003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-36e672eb-973b-4484-80c7-5d16f785317c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:26.488392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-36e672eb-973b-4484-80c7-5d16f785317c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058803 Aug 24 08:27:26.489117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1261/2456] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:27.503185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d2c6a37-8111-44e0-81f4-886e37e2fe05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c740d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:27.575054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d2c6a37-8111-44e0-81f4-886e37e2fe05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.075494 Aug 24 08:27:27.575615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1196/2457] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:28.606983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb9b6916-9280-4286-9704-a653513c74c3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675430>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:28.654800 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb9b6916-9280-4286-9704-a653513c74c3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052173 Aug 24 08:27:28.655371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1262/2458] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:29.669616 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bba1ee1-6652-4083-8b05-4b82f011e2b5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:29.716766 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7bba1ee1-6652-4083-8b05-4b82f011e2b5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.052113 Aug 24 08:27:29.717343 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1197/2459] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:30.731452 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3e68c11-0fca-4e06-8f89-a4e870560e0b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:30.777026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3e68c11-0fca-4e06-8f89-a4e870560e0b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.050447 Aug 24 08:27:30.778116 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1263/2460] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:31.791625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-599fa964-1a77-4c23-b523-29a9c3e0867f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:31.850758 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-599fa964-1a77-4c23-b523-29a9c3e0867f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063229 Aug 24 08:27:31.851331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1198/2461] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:32.861912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=8 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:32.862732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=24 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:32.866649 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b6b4d500-d39f-4a13-bd49-a54f5d21b56a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:32.927804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b6b4d500-d39f-4a13-bd49-a54f5d21b56a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063410 Aug 24 08:27:32.927804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1264/2462] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:33.934831 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=5 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:33.935586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:33.936218 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=90 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:27:33.940992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0dd5a41-e762-459b-bd46-175ec412921b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbaaf0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:33.997183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a0dd5a41-e762-459b-bd46-175ec412921b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063165 Aug 24 08:27:33.997795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1199/2463] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:35.011441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-38a58449-1edf-4e05-8941-3e08a0103deb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:35.069018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-38a58449-1edf-4e05-8941-3e08a0103deb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062451 Aug 24 08:27:35.069612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1265/2464] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:36.084385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f9df027-567f-4a88-939d-7669c3aff79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:36.141830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f9df027-567f-4a88-939d-7669c3aff79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062612 Aug 24 08:27:36.142400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1200/2465] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:37.157430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-05901f7d-0043-4250-80c6-f5512dc86317 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63ee50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:37.219366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-05901f7d-0043-4250-80c6-f5512dc86317 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067942 Aug 24 08:27:37.220082 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1266/2466] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:38.234242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9147719-2550-421f-b9df-e0f1e3557729 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4fb80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:38.299192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9147719-2550-421f-b9df-e0f1e3557729 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067491 Aug 24 08:27:38.299192 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1201/2467] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:39.310322 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-80ca2f71-7781-4d43-af15-e60028af3b4a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:39.367501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-80ca2f71-7781-4d43-af15-e60028af3b4a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061560 Aug 24 08:27:39.368059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1267/2468] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:40.381861 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d4fd288-57af-4a9a-8845-c026fbdbf3ac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:40.437395 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7d4fd288-57af-4a9a-8845-c026fbdbf3ac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.059875 Aug 24 08:27:40.437987 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1202/2469] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:41.451474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dcd73ce8-c9a7-425f-942e-63b8ffe6b824 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d834c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:41.513645 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dcd73ce8-c9a7-425f-942e-63b8ffe6b824 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066875 Aug 24 08:27:41.516120 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1268/2470] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:42.528151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5d5ece14-419a-483f-b3e9-e2afd7607f9b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:42.583488 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5d5ece14-419a-483f-b3e9-e2afd7607f9b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060108 Aug 24 08:27:42.584212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1203/2471] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:43.598372 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-507048d1-9d28-4bca-bc4f-b9e10555edf3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:43.660151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-507048d1-9d28-4bca-bc4f-b9e10555edf3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065988 Aug 24 08:27:43.660752 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1269/2472] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:44.674980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a673b640-f8a1-402d-9009-7605b735286e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d189d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:44.732175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a673b640-f8a1-402d-9009-7605b735286e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061549 Aug 24 08:27:44.732779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1204/2473] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:27:45.746539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-be24f35a-1f5b-44a8-8180-78e5f2fbe18d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b675670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:45.802642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-be24f35a-1f5b-44a8-8180-78e5f2fbe18d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060596 Aug 24 08:27:45.803373 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1270/2474] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:46.816784 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39551d3e-6130-4631-81ca-aaa9a7feb6e7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713c10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:46.875086 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39551d3e-6130-4631-81ca-aaa9a7feb6e7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063015 Aug 24 08:27:46.875657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1205/2475] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:47.889853 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-44f64564-3ff9-46dd-a571-e1a0395e235b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:47.945445 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-44f64564-3ff9-46dd-a571-e1a0395e235b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060548 Aug 24 08:27:47.946012 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1271/2476] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:48.959797 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bad04936-3231-49e5-97cd-0a03511efc68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74e50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:49.020073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bad04936-3231-49e5-97cd-0a03511efc68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064489 Aug 24 08:27:49.020639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1206/2477] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:50.034236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cb1198da-3a35-454c-90f2-fdcb899c529d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63e550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:50.092627 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cb1198da-3a35-454c-90f2-fdcb899c529d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062639 Aug 24 08:27:50.093214 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1272/2478] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:51.107378 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5fbec65d-a76b-483e-8834-0d865969dffd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:51.171903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5fbec65d-a76b-483e-8834-0d865969dffd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063340 Aug 24 08:27:51.171903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1207/2479] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:52.183673 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c3d055e5-c379-4982-80ac-e51217321708 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d1f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:52.237902 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c3d055e5-c379-4982-80ac-e51217321708 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.058792 Aug 24 08:27:52.238475 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1273/2480] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:53.252058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ae7fcb4-d841-4d15-8413-cf02c4b9a0d3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:53.309570 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ae7fcb4-d841-4d15-8413-cf02c4b9a0d3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061323 Aug 24 08:27:53.310135 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1208/2481] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:54.322872 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5ae05155-f5c1-4a08-9368-8fcbba4a428d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d975e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:54.383430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5ae05155-f5c1-4a08-9368-8fcbba4a428d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064861 Aug 24 08:27:54.384150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1274/2482] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:55.401961 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-12873fc7-e9ad-47fe-82b0-a92cad2774a9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:55.453745 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-12873fc7-e9ad-47fe-82b0-a92cad2774a9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.056079 Aug 24 08:27:55.454311 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1209/2483] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:56.467810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9553d4c6-92ea-45d6-b00d-4da0fe8809b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:56.526008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9553d4c6-92ea-45d6-b00d-4da0fe8809b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062600 Aug 24 08:27:56.531282 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1275/2484] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:57.541127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44e1d119-f95e-4560-ad45-565b3b6b1563 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b639280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:57.598620 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44e1d119-f95e-4560-ad45-565b3b6b1563 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061819 Aug 24 08:27:57.599240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1210/2485] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:58.612911 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-058e095f-c081-445d-9ec9-dacb9c4417e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:58.670433 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-058e095f-c081-445d-9ec9-dacb9c4417e1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061909 Aug 24 08:27:58.671320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1276/2486] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:27:59.685073 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7b9e4b57-8b2c-41d2-a018-0bde301f3a69 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45637335e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:27:59.744908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7b9e4b57-8b2c-41d2-a018-0bde301f3a69 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064416 Aug 24 08:27:59.746020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1211/2487] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:27:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:00.759315 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-06eda5f9-affe-487f-a87c-e2b5044b5a21 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:00.817227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-06eda5f9-affe-487f-a87c-e2b5044b5a21 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062148 Aug 24 08:28:00.817792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1277/2488] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:01.832890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e14ca16e-aa7b-468d-86cd-c8ba68621c1e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c74310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:01.893959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e14ca16e-aa7b-468d-86cd-c8ba68621c1e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066549 Aug 24 08:28:01.894529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1212/2489] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:02.909382 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cf0b6c48-3faa-470a-ab18-a28a1b9bb6af tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:02.966388 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cf0b6c48-3faa-470a-ab18-a28a1b9bb6af tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061380 Aug 24 08:28:02.967022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1278/2490] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:03.980302 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-33ebfb2e-9b5f-4b21-bb40-e0b0afd5a9a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b639430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:04.038682 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-33ebfb2e-9b5f-4b21-bb40-e0b0afd5a9a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063226 Aug 24 08:28:04.039337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1213/2491] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:05.053345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d3a24974-3f0d-4b55-a284-355fd21dc16b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:05.115552 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d3a24974-3f0d-4b55-a284-355fd21dc16b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.066460 Aug 24 08:28:05.116123 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1279/2492] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:06.131219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df385a40-f6fb-48d5-a3b2-9f1f906e1e95 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:06.189490 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df385a40-f6fb-48d5-a3b2-9f1f906e1e95 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062529 Aug 24 08:28:06.190205 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1214/2493] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:07.203885 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-67fafb5b-d249-4c9b-9c73-0791db4d4f41 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:07.260476 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-67fafb5b-d249-4c9b-9c73-0791db4d4f41 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061217 Aug 24 08:28:07.261392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1280/2494] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:08.275410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b374b75d-a48d-4da1-8cc6-e07a84ee4489 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4f280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:08.338473 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b374b75d-a48d-4da1-8cc6-e07a84ee4489 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.067446 Aug 24 08:28:08.339762 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1215/2495] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:09.351525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-09c3d707-359e-465d-b3e1-6505e1e08c6a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:09.408761 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-09c3d707-359e-465d-b3e1-6505e1e08c6a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061401 Aug 24 08:28:09.409401 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1281/2496] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:10.422920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7f42a7c-b9d0-4143-917d-8a0a1d823260 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8b0d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:10.482933 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7f42a7c-b9d0-4143-917d-8a0a1d823260 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064392 Aug 24 08:28:10.483514 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1216/2497] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:11.496962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6373fdbe-329f-4365-8707-433a0963f0a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63eaf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:11.557510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6373fdbe-329f-4365-8707-433a0963f0a3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.064761 Aug 24 08:28:11.558247 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1282/2498] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:12.571657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f11b3fe-350d-4f24-a96a-5c753eee68f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:12.630546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f11b3fe-350d-4f24-a96a-5c753eee68f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063151 Aug 24 08:28:12.631112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1217/2499] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:13.645527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-eb491313-6793-44ee-b5eb-dfaadae190db tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:13.701451 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-eb491313-6793-44ee-b5eb-dfaadae190db tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.060189 Aug 24 08:28:13.702021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1283/2500] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:14.718313 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c0580a4-bebf-445d-8612-564b8d495b75 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:14.774330 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0c0580a4-bebf-445d-8612-564b8d495b75 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061034 Aug 24 08:28:14.774906 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1218/2501] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:15.788879 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f1841ae4-2e31-44a6-a1df-ee0d838e15f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97b80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:15.847059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f1841ae4-2e31-44a6-a1df-ee0d838e15f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.062314 Aug 24 08:28:15.852961 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1284/2502] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:16.861591 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2cd4c3f9-509b-484b-ba28-8f454fab23c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6395e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:16.918520 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2cd4c3f9-509b-484b-ba28-8f454fab23c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.061105 Aug 24 08:28:16.919099 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1219/2503] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:17.932727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2e8225b2-00e2-4ab1-bc88-80a954be209e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:17.993629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2e8225b2-00e2-4ab1-bc88-80a954be209e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.065192 Aug 24 08:28:17.994197 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1285/2504] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:19.012769 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b0c30fde-ab5c-4e00-a856-856536b303e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b64c1f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:19.069370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b0c30fde-ab5c-4e00-a856-856536b303e9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 345 microversion: 2.1 time: 0.063699 Aug 24 08:28:19.070677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1220/2505] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:20.085166 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e2b271ca-683b-4ac3-a458-c46641c7edb3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:20.153353 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e2b271ca-683b-4ac3-a458-c46641c7edb3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.071805 Aug 24 08:28:20.159416 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1286/2506] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:20.386574 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4176998-10ad-4b3e-9ddd-f1d2752445cd"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:28:20.389780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:20.396060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:20.398147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:20.398147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:20.398147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:20.398437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:20.398609 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:21.166806 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bc5e7573-8997-4e95-a1ea-58adad56b52b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:21.229578 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bc5e7573-8997-4e95-a1ea-58adad56b52b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.066969 Aug 24 08:28:21.230175 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1287/2507] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:21.359556 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-38db6403-83b5-4473-81f9-0e0e1f6a2458 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977198 Aug 24 08:28:21.360157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1221/2508] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 24 08:28:20 2022] POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:22.251541 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-206515e9-9413-4daa-bbd0-3d12dfaa081c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:22.298625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-206515e9-9413-4daa-bbd0-3d12dfaa081c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051647 Aug 24 08:28:22.299215 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1288/2509] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:23.313767 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5cd6deaf-4562-48a5-b794-8f37d0391c1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:23.360497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5cd6deaf-4562-48a5-b794-8f37d0391c1c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051922 Aug 24 08:28:23.361122 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1222/2510] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:24.374735 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2eb981b2-87b7-4edd-9c51-e69bad1a593f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:24.432118 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2eb981b2-87b7-4edd-9c51-e69bad1a593f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.061840 Aug 24 08:28:24.432711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1289/2511] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:25.446237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-225bcdb1-24a7-43cf-b2b4-ea3c7bc4df5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:25.493870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-225bcdb1-24a7-43cf-b2b4-ea3c7bc4df5c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051867 Aug 24 08:28:25.495303 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1223/2512] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:26.508563 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96a2a3fa-2f9f-41d2-a98a-75e21847ff99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:26.571810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96a2a3fa-2f9f-41d2-a98a-75e21847ff99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.064327 Aug 24 08:28:26.571810 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1290/2513] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:27.583891 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-adaf3a5b-4a4a-4a21-8477-510ab610ce85 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:27.636020 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-adaf3a5b-4a4a-4a21-8477-510ab610ce85 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.056540 Aug 24 08:28:27.636605 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1224/2514] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:28.650296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f3526246-ff67-4df9-999a-74acd75ec639 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d833a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:28.697086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f3526246-ff67-4df9-999a-74acd75ec639 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051245 Aug 24 08:28:28.697644 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1291/2515] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:29.711040 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ce51452-000b-41ca-bb8d-1aef1c48b6eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:29.757401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ce51452-000b-41ca-bb8d-1aef1c48b6eb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050679 Aug 24 08:28:29.757953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1225/2516] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:30.771716 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f02cc224-f612-46fd-9fc6-a18fc80a0ebb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:30.818863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f02cc224-f612-46fd-9fc6-a18fc80a0ebb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051455 Aug 24 08:28:30.819424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1292/2517] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:31.835298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:28:31.835298 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:28:31.835806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e56cf4d8-083b-482a-933e-6abf7529c4ce tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:31.882876 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e56cf4d8-083b-482a-933e-6abf7529c4ce tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053807 Aug 24 08:28:31.886695 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1226/2518] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:32.135517 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:32.136126 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:32.142825 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:32.143310 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:32.143746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:32.144439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:32.144900 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:32.145330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:32.276628 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:32.285460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a52b8301-0093-454f-8c30-9b4a4fcd1bd5 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1594 microversion: 2.1 time: 0.154166 Aug 24 08:28:32.286028 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1293/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:32 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:32.899637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05df5581-5a2f-499a-b855-e3477410149f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:32.953558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-05df5581-5a2f-499a-b855-e3477410149f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.060472 Aug 24 08:28:32.954148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1227/2520] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:33.968074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5bb49a16-672a-4500-b782-d3875d35e795 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63ef70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:34.026965 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5bb49a16-672a-4500-b782-d3875d35e795 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.063324 Aug 24 08:28:34.033090 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1294/2521] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:34.299226 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:28:34.311690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:34.312327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:34.312781 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:34.324808 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] Creating event network-changed:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:28:34.332126 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-1d99b849-7fab-4a7f-a21a-b01cefd5eea3 req-bcaca969-f81e-4ed6-af6b-7577dab74a47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037558 Aug 24 08:28:34.333527 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1228/2522] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:35.042642 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ce2a35e9-a268-4fe4-8545-246e93eb38d6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fa60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:35.137222 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ce2a35e9-a268-4fe4-8545-246e93eb38d6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.098854 Aug 24 08:28:35.138520 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1295/2523] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:36.151661 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fc85c4cf-2942-4ecb-a16a-cd9ee06f1933 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:36.202777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fc85c4cf-2942-4ecb-a16a-cd9ee06f1933 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055325 Aug 24 08:28:36.203352 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1229/2524] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:37.102763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-866002908"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:28:37.103615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:37.111360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:37.112117 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:37.112893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:37.113901 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:37.114593 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:37.115227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:37.219043 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4f16ac2e-1c63-4e5b-b778-8b68bc19a137 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45682a3d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:37.295336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4f16ac2e-1c63-4e5b-b778-8b68bc19a137 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.081615 Aug 24 08:28:37.304441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1230/2525] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:37.340441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.network.security_group_api [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Adding security group b4d49801-2e60-4681-9d49-d043cfbbe74e to port 0a7a223a-ea0d-428f-9eef-3386d0b294d6 Aug 24 08:28:37.977207 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-faf0141d-fad7-4f81-9e69-dbc24b949e2e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action" status: 202 len: 0 microversion: 2.1 time: 0.878166 Aug 24 08:28:37.977882 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1296/2526] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 08:28:37 2022] POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:28:37.986684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:37.987405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:38.002754 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:28:38.021344 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:38.022009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:38.024049 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:38.028288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:38.031085 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:38.031680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:38.036629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:38.037124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:38.037544 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:38.059780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] Creating event network-changed:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:28:38.074320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-e0dc74db-131b-493d-aa38-89e98ae25b50 req-b094a57c-7689-4f18-b345-21dd1024d6bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076098 Aug 24 08:28:38.079072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1297/2527] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:38.315107 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fb44e63b-4ae7-4f09-8551-484f41b8c710 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562db7e50>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:38.323131 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:38.339398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2451f503-1283-4740-98bd-ea4372f9621a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1759 microversion: 2.1 time: 0.357227 Aug 24 08:28:38.339980 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1231/2528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:37 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1759 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:38.398841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fb44e63b-4ae7-4f09-8551-484f41b8c710 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.090201 Aug 24 08:28:38.399601 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1298/2529] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:39.448373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-834fda40-b579-43d1-bdab-bc74dcbd45fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:39.463954 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-834fda40-b579-43d1-bdab-bc74dcbd45fb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054084 Aug 24 08:28:39.464726 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1232/2530] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:39.569491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:28:39.571838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:39.579399 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:39.579867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:39.580291 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:39.580995 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:39.581439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:39.581851 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:39.798801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9192cf91-ff37-4407-888f-26f563ab4beb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action" status: 202 len: 0 microversion: 2.1 time: 0.233644 Aug 24 08:28:39.799430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1299/2531] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 08:28:39 2022] POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:28:39.808202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:39.808833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:39.815526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:39.816199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:39.816628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:39.817347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:39.817793 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:39.818206 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:39.963356 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:39.971839 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-11ff808a-b040-43ca-a2cb-5ac18b3d188c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1751 microversion: 2.1 time: 0.167696 Aug 24 08:28:39.972405 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1233/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:39 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:40.479470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-607b077c-7d71-4a03-a2ea-b231b2f14c56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:40.532302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-607b077c-7d71-4a03-a2ea-b231b2f14c56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.056928 Aug 24 08:28:40.532926 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1300/2533] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:40.993221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:40.994420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:41.003018 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:41.003575 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:41.004016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:41.004772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:41.005229 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:41.005656 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:41.160439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:41.170017 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-65eae872-c47d-4266-bf5d-6ef75fb118c4 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.180780 Aug 24 08:28:41.174905 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1234/2534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:40 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:41.546838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-381088c9-26cb-4616-b347-4784c0d7b948 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a53a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:41.596007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-381088c9-26cb-4616-b347-4784c0d7b948 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053869 Aug 24 08:28:41.596575 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1301/2535] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:42.191581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:42.192186 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:42.198648 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:42.199120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:42.199567 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:42.200224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:42.200699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:42.201220 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:42.344809 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:42.353095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-63c47b3d-f2d7-46c7-b074-9484c1ae61d1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.165403 Aug 24 08:28:42.353647 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1235/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:42 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:42.609937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-329b71bb-207d-4128-bd69-d25ba6d8cf53 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:42.658833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-329b71bb-207d-4128-bd69-d25ba6d8cf53 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053565 Aug 24 08:28:42.659396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1302/2537] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:43.374397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:43.375004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:43.381460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:43.381940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:43.382372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:43.383063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:43.383507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:43.383926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:43.527727 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:43.536197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-48528439-fe03-4f87-bbdf-5ff6264f9684 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.165707 Aug 24 08:28:43.536912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1236/2538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:43 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:43.673139 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f123ade7-cfa1-40f6-9663-e9294efa10f5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:43.719061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f123ade7-cfa1-40f6-9663-e9294efa10f5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050477 Aug 24 08:28:43.719618 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1303/2539] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:44.558181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:44.558899 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:44.565477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:44.565948 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:44.566374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:44.567052 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:44.567495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:44.567908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:44.708175 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:44.716475 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3092173f-747e-4ea4-98d3-9548471ce12c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.162122 Aug 24 08:28:44.717880 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1237/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:44 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:44.733237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bc889ae1-c973-4291-b51f-ef17204afd20 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:44.778314 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bc889ae1-c973-4291-b51f-ef17204afd20 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049428 Aug 24 08:28:44.778867 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1304/2541] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:45.738840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:45.739439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:45.745916 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:45.751433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:45.751433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:45.751433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:45.751433 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:45.751735 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:45.793355 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-14b20d83-d545-48a4-b812-86b564dc61a2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:45.843211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-14b20d83-d545-48a4-b812-86b564dc61a2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054056 Aug 24 08:28:45.843908 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1305/2542] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:45.896873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:45.905273 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1133cd22-2e69-4235-821b-355e3f4c3060 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.169538 Aug 24 08:28:45.906281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1238/2543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:45 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:46.858072 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0b08cf23-933b-4381-925d-b62c9806eeeb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72faf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:46.903619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0b08cf23-933b-4381-925d-b62c9806eeeb tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050279 Aug 24 08:28:46.904258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1306/2544] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:46.926457 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:46.927064 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:46.933442 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:46.933926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:46.934361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:46.935061 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:46.936104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:46.936741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:47.081398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:47.089547 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aff1c4ea-62ee-48f9-9e23-cbec4594e7dd tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.166878 Aug 24 08:28:47.090105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1239/2545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:46 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:47.917833 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-afd32fc9-c967-4785-ac1e-96c84cb19a68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:47.964502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-afd32fc9-c967-4785-ac1e-96c84cb19a68 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050851 Aug 24 08:28:47.965105 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1307/2546] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:48.110994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:48.111622 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:48.118058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:48.118533 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:48.118965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:48.119642 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:48.120089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:48.120504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:48.264637 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:48.272489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f433298a-0c57-4d12-bc14-1710a5f52573 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.166082 Aug 24 08:28:48.273095 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1240/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:48 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:48.979220 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-54f0da58-f880-43da-9f27-56ee871c2f2c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:49.025987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-54f0da58-f880-43da-9f27-56ee871c2f2c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050952 Aug 24 08:28:49.026551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1308/2548] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:49.294721 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:49.295235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:49.302374 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:49.302847 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:49.303278 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:49.303964 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:49.304406 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:49.304859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:49.446971 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:49.458009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2784b6e4-d68d-48b2-a4b2-7545f271210a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.167350 Aug 24 08:28:49.459045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1241/2549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:49 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:50.035992 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=8 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:28:50.037161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:28:50.041320 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-61a560b9-1edf-49d3-a6fb-6627e72792b2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:50.091838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-61a560b9-1edf-49d3-a6fb-6627e72792b2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.056532 Aug 24 08:28:50.092477 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1309/2550] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:50.487401 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:50.488011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:50.494686 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:50.495160 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:50.495587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:50.496271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:50.496746 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:50.497164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:50.641736 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:50.649890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3906766a-852f-407b-a97b-e878a49a8f53 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.167038 Aug 24 08:28:50.650450 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1242/2551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:50 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:51.106159 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0e14c05f-fb7a-44ca-9d03-9ab817782764 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:51.151840 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0e14c05f-fb7a-44ca-9d03-9ab817782764 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050234 Aug 24 08:28:51.152430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1310/2552] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:51.672105 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:51.672623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:51.678931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:51.679403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:51.679825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:51.680503 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:51.680967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:51.681383 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:51.825332 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:51.833851 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a75841a-c3c0-4603-8cfc-b5fd261c3150 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.166740 Aug 24 08:28:51.834415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1243/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:51 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:52.167278 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-185cca5b-eefe-4a05-82c6-ffa7dc556b9d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:52.228071 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-185cca5b-eefe-4a05-82c6-ffa7dc556b9d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.065419 Aug 24 08:28:52.228654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1311/2554] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:52.856096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:52.856724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:52.863639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:52.864113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:52.864545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:52.865279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:52.865753 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:52.866191 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:53.014454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:53.022638 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ccf0252b-169d-476f-a8ad-cb026821476e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.170547 Aug 24 08:28:53.023195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1244/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:52 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:28:53.244061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7df26055-87e7-40e2-ac1a-17978de6e9e3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fd30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:53.289407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7df26055-87e7-40e2-ac1a-17978de6e9e3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049716 Aug 24 08:28:53.289962 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1312/2556] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:54.043142 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:54.043752 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:54.050920 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:54.051397 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:54.051828 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:54.052511 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:54.053016 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:54.053435 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:54.208338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:54.217957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c100a4fb-2ac9-46d9-bb21-6a6053ad0199 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.178017 Aug 24 08:28:54.218524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1245/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:54 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:54.304463 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f077b9cd-11aa-4ee3-a020-1537a957de99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:54.352055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f077b9cd-11aa-4ee3-a020-1537a957de99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051794 Aug 24 08:28:54.352617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1313/2558] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:55.239581 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:55.240199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:55.246956 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:55.247212 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:55.247664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:55.248368 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:55.249728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:55.250164 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:55.367001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-926b4f85-2d11-4015-9316-249d91319372 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:55.403031 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:55.412925 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d556d362-74e5-43bf-983c-cacbe9abcb1c tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.177072 Aug 24 08:28:55.413551 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1246/2559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:55 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:55.428464 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-926b4f85-2d11-4015-9316-249d91319372 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.065835 Aug 24 08:28:55.429059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1314/2560] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:56.434985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:56.435588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:56.442376 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:56.442685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bf9027ad-ed2d-453f-9753-82b501d968a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:56.443128 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:56.443263 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:56.444001 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:56.444456 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:56.444909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:56.491396 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bf9027ad-ed2d-453f-9753-82b501d968a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053045 Aug 24 08:28:56.491957 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1315/2561] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:28:56.591153 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:56.600788 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-55db58d1-adce-4796-93d3-7dae65467ff6 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.169405 Aug 24 08:28:56.601362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1247/2562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:56 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:57.505751 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7449ea91-8f76-4a8f-8e82-20dcb065de13 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:57.552733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7449ea91-8f76-4a8f-8e82-20dcb065de13 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050984 Aug 24 08:28:57.553304 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1316/2563] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:57.622279 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:57.622894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:57.630157 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:57.630678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:57.631112 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:57.631796 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:57.632248 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:57.632696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:57.636898 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:28:57.781019 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:57.789362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0c5ff93-c890-443d-a027-732453f540cc tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.170961 Aug 24 08:28:57.789911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1248/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:57 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:58.567013 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-18b95108-13d1-4f5e-9a5b-219940cbf481 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63edc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:58.614763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-18b95108-13d1-4f5e-9a5b-219940cbf481 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051918 Aug 24 08:28:58.615325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1317/2565] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:58.810926 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:58.811615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:58.818030 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:58.818500 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:58.818932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:58.819611 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:58.820060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:58.820477 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:28:58.961914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:28:58.970341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00b157c7-1200-42a7-820d-2fe7590e6a21 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.163327 Aug 24 08:28:58.970903 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1249/2566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:58 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:28:59.629341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4b32e124-7366-4b2e-8353-76935e459b8d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:59.675983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4b32e124-7366-4b2e-8353-76935e459b8d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050804 Aug 24 08:28:59.676551 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1318/2567] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:28:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:28:59.991369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:28:59.991974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:28:59.998371 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:28:59.998921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:28:59.999351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:00.000027 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:00.000469 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:00.000909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:00.147416 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:00.156144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36b57bc7-ebe5-4ad8-860b-492e8c0f5970 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.168537 Aug 24 08:29:00.156724 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1250/2568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:28:59 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:00.690950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-aca9db55-5bc9-482d-9a02-9d9221562374 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7003a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:00.737964 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-aca9db55-5bc9-482d-9a02-9d9221562374 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052238 Aug 24 08:29:00.738560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1319/2569] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:01.176943 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:01.177554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:01.183947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:01.184429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:01.184890 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:01.185598 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:01.186127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:01.186544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:01.327484 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:01.335846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8e0f01cf-5d2f-4e0b-89a8-5eff725b0352 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.162762 Aug 24 08:29:01.336410 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1251/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:01 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:01.752042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4b2a4398-c4c9-4894-9aaa-62d5d6f78e8d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83c10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:01.797580 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4b2a4398-c4c9-4894-9aaa-62d5d6f78e8d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049918 Aug 24 08:29:01.798144 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1320/2571] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:02.358269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:02.358882 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:02.365306 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:02.365789 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:02.366224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:02.366915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:02.367359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:02.367780 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:02.512321 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:02.520723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83817474-32cc-49bd-8f20-67d09fcbc43b tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.166955 Aug 24 08:29:02.521291 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1252/2572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:02 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:02.811778 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-366de7f4-c04d-40c4-9c8d-2326523d3f7a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72faf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:02.858527 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-366de7f4-c04d-40c4-9c8d-2326523d3f7a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050358 Aug 24 08:29:02.859088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1321/2573] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:03.542301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:03.542915 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:03.546231 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=45 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:29:03.550976 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:03.551452 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:03.552033 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:03.552755 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:03.553209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:03.553639 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:03.698610 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:03.706981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb6fe87c-a605-4de8-a51e-37e88d2945ad tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.168492 Aug 24 08:29:03.707544 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1253/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:03 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:29:03.872736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ca82e05e-ff1d-495b-b3e7-d476c6d1db15 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:03.921187 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ca82e05e-ff1d-495b-b3e7-d476c6d1db15 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051715 Aug 24 08:29:03.921758 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1322/2575] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:04.728708 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:04.729240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:04.736090 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:04.736561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:04.737023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:04.737696 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:04.738139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:04.738552 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:04.878773 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:04.886984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-edc75895-8c90-4f66-ae3a-d6fb696ae030 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.162341 Aug 24 08:29:04.887545 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1254/2576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:04 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:04.935065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-17d7d301-cdca-41a4-af82-9ad0ab5f1c89 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d838b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:04.980589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-17d7d301-cdca-41a4-af82-9ad0ab5f1c89 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049618 Aug 24 08:29:04.981155 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1323/2577] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:05.907428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:05.908037 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:05.914678 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:05.915180 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:05.915608 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:05.916312 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:05.916785 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:05.917202 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:05.994990 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6cfc361c-233d-4213-a9e0-9918bdb0f3f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f1f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:06.042121 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6cfc361c-233d-4213-a9e0-9918bdb0f3f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051420 Aug 24 08:29:06.042688 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1324/2578] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:06.066201 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:06.074447 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b0be6f02-9365-41da-8eb4-5f77804d07cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.170949 Aug 24 08:29:06.075009 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1255/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:05 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:07.056301 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-209ed5bc-3475-42c3-9857-d4948be322ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:07.096168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:07.096829 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:07.103292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:07.103775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:07.104209 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:07.104449 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-209ed5bc-3475-42c3-9857-d4948be322ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052394 Aug 24 08:29:07.104945 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:07.105069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1325/2580] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:07.105392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:07.105826 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:07.250032 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:07.258430 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44dc982f-3662-4bf0-81f9-4dfd7659de5a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1756 microversion: 2.1 time: 0.166935 Aug 24 08:29:07.258998 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1256/2581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:07 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:29:08.119132 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ae177b23-56ba-4400-a0fd-b1b3e91c70aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:08.172050 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ae177b23-56ba-4400-a0fd-b1b3e91c70aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.057352 Aug 24 08:29:08.172713 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1326/2582] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:08.280347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:08.281056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:08.287491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:08.287991 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:08.288429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:08.289141 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:08.289586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:08.290000 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:08.437056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:08.445296 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2df53137-4c11-4b49-bc20-ff6b7fb9a355 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1759 microversion: 2.1 time: 0.169482 Aug 24 08:29:08.445870 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1257/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:08 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:09.185890 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1bcd8b93-2687-46b2-bdcc-06fcf32a1573 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fc10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:09.232037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1bcd8b93-2687-46b2-bdcc-06fcf32a1573 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050152 Aug 24 08:29:09.232608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1327/2584] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:10.246193 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-41f7f82d-d4ff-4296-88cc-3efdbadf9829 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c409d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:10.293959 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-41f7f82d-d4ff-4296-88cc-3efdbadf9829 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051419 Aug 24 08:29:10.294522 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1258/2585] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:11.307240 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bcaa1579-1902-4a48-982a-81a321abf3b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f1f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:11.355834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bcaa1579-1902-4a48-982a-81a321abf3b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050370 Aug 24 08:29:11.355834 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1328/2586] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:12.369815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a87b4e84-b93a-437e-97ff-7b87ff9692f4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7138b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:12.421357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a87b4e84-b93a-437e-97ff-7b87ff9692f4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055687 Aug 24 08:29:12.421932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1259/2587] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:13.435506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a4357b6d-8f30-4628-b633-9c712f3750bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71bee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:13.482607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a4357b6d-8f30-4628-b633-9c712f3750bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051376 Aug 24 08:29:13.483407 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1329/2588] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:14.501923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4de9e859-620b-403f-a4d8-609051991256 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bb80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:14.553034 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4de9e859-620b-403f-a4d8-609051991256 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055528 Aug 24 08:29:14.553827 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1260/2589] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:15.570048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fae60cd6-c197-48aa-87ae-637fb3381c0c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:15.618918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fae60cd6-c197-48aa-87ae-637fb3381c0c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053421 Aug 24 08:29:15.619489 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1330/2590] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:16.634096 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ed3a83da-126b-4541-b46f-c97a8c4852d0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:16.684760 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ed3a83da-126b-4541-b46f-c97a8c4852d0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055262 Aug 24 08:29:16.685336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1261/2591] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:17.700134 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-869f73a4-554d-440b-a86b-d4dbea718db8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97ee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:17.747122 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-869f73a4-554d-440b-a86b-d4dbea718db8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051711 Aug 24 08:29:17.747696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1331/2592] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:18.758048 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=9 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:29:18.758909 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=58 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:29:18.762599 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-885eb002-1426-4273-86e3-e0a8a26a4849 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9ac10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:18.809336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-885eb002-1426-4273-86e3-e0a8a26a4849 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052450 Aug 24 08:29:18.809923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1262/2593] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:19.823725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-47c6d474-3b76-4bd9-b9ce-0961c951e301 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b717670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:19.870045 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-47c6d474-3b76-4bd9-b9ce-0961c951e301 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050704 Aug 24 08:29:19.870643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1332/2594] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:20.884921 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3fd6f55a-ae30-4f4f-b129-fd9108db16e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc1670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:20.933167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3fd6f55a-ae30-4f4f-b129-fd9108db16e5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052816 Aug 24 08:29:20.933728 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1263/2595] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:21.947668 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d15ab702-12a0-4002-a6eb-76ecd7440a14 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:21.993937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d15ab702-12a0-4002-a6eb-76ecd7440a14 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050527 Aug 24 08:29:21.994525 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1333/2596] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:23.007850 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1159a56e-f33f-49bb-a408-9b9a12b55fa1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7138b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:23.054693 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1159a56e-f33f-49bb-a408-9b9a12b55fa1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051134 Aug 24 08:29:23.055257 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1264/2597] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:24.069647 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7800cee2-4de1-4a7c-9d09-6a6e4dbbb330 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63eb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:24.116621 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7800cee2-4de1-4a7c-9d09-6a6e4dbbb330 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051582 Aug 24 08:29:24.117199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1334/2598] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:25.131254 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1cd4b025-d2b3-4cb1-acdf-79bf2c91433d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:25.177937 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1cd4b025-d2b3-4cb1-acdf-79bf2c91433d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050961 Aug 24 08:29:25.178504 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1265/2599] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:26.191949 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c74593ea-e03a-4ce1-a3a1-a029072557fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b717dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:26.354236 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c74593ea-e03a-4ce1-a3a1-a029072557fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.166844 Aug 24 08:29:26.354956 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1335/2600] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:27.369078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03c30f01-2712-42db-bcb1-d78528a55593 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:27.632195 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03c30f01-2712-42db-bcb1-d78528a55593 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.267505 Aug 24 08:29:27.632790 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1266/2601] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:28.646930 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0f555b18-1adc-4c8b-b9ae-9c7da1029b56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:28.698150 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0f555b18-1adc-4c8b-b9ae-9c7da1029b56 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055933 Aug 24 08:29:28.698775 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1336/2602] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:29.711872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-59a3ba31-0122-4f91-a821-a1bef0f23eae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:29.759928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-59a3ba31-0122-4f91-a821-a1bef0f23eae tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052407 Aug 24 08:29:29.760501 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1267/2603] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:30.775979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9a2c27a0-4dc3-44e6-a69c-71db109d6df4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72faf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:30.824182 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9a2c27a0-4dc3-44e6-a69c-71db109d6df4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054516 Aug 24 08:29:30.824796 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1337/2604] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:31.838889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c6d39d1-4f50-4f85-8c56-902247f0829b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aa60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:31.885801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c6d39d1-4f50-4f85-8c56-902247f0829b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051335 Aug 24 08:29:31.886370 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1268/2605] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:32.900345 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3661e122-3433-4892-b5f7-00d95f5c9c26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ea550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:32.947904 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3661e122-3433-4892-b5f7-00d95f5c9c26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052013 Aug 24 08:29:32.948481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1338/2606] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:33.963764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee446097-e85d-46ef-a456-04d8de695884 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:34.011586 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee446097-e85d-46ef-a456-04d8de695884 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052764 Aug 24 08:29:34.012183 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1269/2607] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:35.025976 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-37b05a2e-24cc-4e95-a69d-d053e0052908 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:35.076938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-37b05a2e-24cc-4e95-a69d-d053e0052908 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049836 Aug 24 08:29:35.076938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1339/2608] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:36.085699 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d62e0a33-1202-4ab5-a6d7-fb8634faf8a4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7138b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:36.135039 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d62e0a33-1202-4ab5-a6d7-fb8634faf8a4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053510 Aug 24 08:29:36.135602 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1270/2609] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:37.149327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2baa8eb6-61b3-42d3-909e-c2d17a1dbc6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d831f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:37.196422 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2baa8eb6-61b3-42d3-909e-c2d17a1dbc6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051512 Aug 24 08:29:37.197023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1340/2610] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:38.210865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-63e86ccf-cd5c-413e-9e19-05e720bac3b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:38.263628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-63e86ccf-cd5c-413e-9e19-05e720bac3b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.057237 Aug 24 08:29:38.264743 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1271/2611] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:39.276617 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7f357309-ec21-4aa3-b49a-5cb98a45dc3c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83dc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:39.325554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7f357309-ec21-4aa3-b49a-5cb98a45dc3c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052676 Aug 24 08:29:39.326179 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1341/2612] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:40.340994 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e132f912-ceb2-4f49-bb70-78179cfa7fc5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d180d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:40.388204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e132f912-ceb2-4f49-bb70-78179cfa7fc5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052057 Aug 24 08:29:40.388795 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1272/2613] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:40.982827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-866002908"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:29:40.982827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:40.982827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:40.982827 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:40.984636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:40.984636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:40.984636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:40.984636 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:41.123053 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.network.security_group_api [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Removing security group b4d49801-2e60-4681-9d49-d043cfbbe74e from port 0a7a223a-ea0d-428f-9eef-3386d0b294d6 Aug 24 08:29:41.402588 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-979648b1-21ea-4a12-b1aa-37faaced8ea3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:41.450004 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-979648b1-21ea-4a12-b1aa-37faaced8ea3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051706 Aug 24 08:29:41.450822 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1273/2614] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:41.523732 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-daa75de0-353f-4aff-82c5-17186c98ab32 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action" status: 202 len: 0 microversion: 2.1 time: 0.561152 Aug 24 08:29:41.527529 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1342/2615] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 24 08:29:40 2022] POST /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:29:41.535304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:29:41.553150 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:41.553843 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:41.554515 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:41.590817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] Creating event network-changed:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:29:41.590817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-9180f578-2ef5-46b2-82ba-f625ea55c68a req-c3c77fa2-e10e-4ef7-8b4e-52472a6930b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057393 Aug 24 08:29:41.590817 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1274/2616] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:42.465606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6e5c9d60-5643-4be1-b383-7b6887f7bec4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:42.516438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6e5c9d60-5643-4be1-b383-7b6887f7bec4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055304 Aug 24 08:29:42.517199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1343/2617] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:42.836428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:42.837092 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:42.844676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:42.845174 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:42.845684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:42.846304 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:42.846741 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:42.847155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:42.935101 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lazy-loading 'services' on Instance uuid 8f33c236-ca2a-4a2e-8c90-80b364c8f056 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:29:42.979251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:29:42.990285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:42.990912 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:42.991174 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:43.001883 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] Creating event network-changed:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:29:43.007177 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-b5ab1bf3-4291-49de-917e-6b19c972a06a req-ba8708a6-13ed-42a6-947c-8074942aa3c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172483 Aug 24 08:29:43.007773 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1344/2618] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:43.152476 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78ce9142-961a-4438-b492-110d820b4ed8 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments/a4176998-10ad-4b3e-9ddd-f1d2752445cd" status: 202 len: 0 microversion: 2.1 time: 0.321668 Aug 24 08:29:43.157384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1275/2619] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:29:42 2022] DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments/a4176998-10ad-4b3e-9ddd-f1d2752445cd => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:29:43.164823 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:43.167037 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:43.177024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:43.177488 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:43.177918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:43.178612 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:43.179063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:43.179473 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:43.224405 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a610a90c-cbff-4a01-9318-ce42f690e65d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064878 Aug 24 08:29:43.225325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1345/2620] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 08:29:43 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:43.530393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-96cad862-63d9-4e8b-96e1-526d9b8d28ad tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d055e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:43.578859 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-96cad862-63d9-4e8b-96e1-526d9b8d28ad tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052720 Aug 24 08:29:43.579428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1276/2621] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:44.237725 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:44.239842 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:44.246296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:44.246763 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:44.247186 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:44.247859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:44.248302 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:44.248746 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:44.277083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-478d85a1-0080-4c00-868c-a4faa872a7f3 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Aug 24 08:29:44.277638 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1346/2622] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 08:29:44 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:44.594051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c9f0cb23-73f4-472f-a6bb-ffdd69173b2a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:44.640182 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c9f0cb23-73f4-472f-a6bb-ffdd69173b2a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051067 Aug 24 08:29:44.640764 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1277/2623] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:45.289721 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:45.291878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:45.299792 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:45.300272 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:45.300724 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:45.301467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:45.301914 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:45.302329 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:45.333539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-75b4cd33-45ee-499b-9cc2-1bb22d4002ce tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047615 Aug 24 08:29:45.334111 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1347/2624] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 08:29:45 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:45.654162 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4020f635-631e-4f5f-9f75-cd726690f521 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c4bee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:45.699992 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4020f635-631e-4f5f-9f75-cd726690f521 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050132 Aug 24 08:29:45.700550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1278/2625] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:46.347281 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:46.349632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:46.356156 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:46.356624 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:46.357077 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:46.357750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:46.358192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:46.358603 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:46.388227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e38f5948-3b0b-4bdb-97a7-ab45f7bbe36a tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Aug 24 08:29:46.388856 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1348/2626] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 08:29:46 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:46.714939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8cad922-9b3c-4bc1-8560-e155d1262964 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:46.761932 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8cad922-9b3c-4bc1-8560-e155d1262964 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051092 Aug 24 08:29:46.768426 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1279/2627] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:47.401510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:47.403613 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:47.410868 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:47.411327 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:47.411747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:47.412413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:47.412877 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:47.413285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:47.442791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8628a5b2-6ce0-49d0-9b34-d2c3e95aae38 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045362 Aug 24 08:29:47.443341 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1349/2628] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 24 08:29:47 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:29:47.453911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:47.456813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:47.460985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:47.461463 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:47.461895 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:47.462640 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:47.463113 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:47.463531 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:47.539235 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] HTTP exception thrown: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 is not attached to volume a4176998-10ad-4b3e-9ddd-f1d2752445cd Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Request method failure captured: Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments/a4176998-10ad-4b3e-9ddd-f1d2752445cd HTTP/1.1 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBeC9RycHhHAqlNcH-IvLMZhPtLer_O7HqHA0Zv6jYBzaCiGkoVg-D666i4hgK80xViAVsi3b3Iy54F9iaW_cyaWn2e4GHw6x20SNrDePdLB5rQD2PZgOyxFQ55frIHIJNwc02kJSxLgGpQPxfLX1_UZ8K6raDdm6LFSjo4kjM-8jYq8 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 19a004d608f2454cb5e9e65eef5ed740 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:29:47.541617 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19a004d608f2454cb5e9e65eef5ed740"}]}] Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 19a004d608f2454cb5e9e65eef5ed740 Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-TestMinimumBasicScenario-2081517431-project Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: b5600f62677d437ead57459e3cf75e41 Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-TestMinimumBasicScenario-2081517431-project Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:29:47.543424 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 is not attached to volume a4176998-10ad-4b3e-9ddd-f1d2752445cd Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '8f33c236-ca2a-4a2e-8c90-80b364c8f056', 'id': 'a4176998-10ad-4b3e-9ddd-f1d2752445cd'} Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a4176998-10ad-4b3e-9ddd-f1d2752445cd. Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:29:47.544215 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 is not attached to volume a4176998-10ad-4b3e-9ddd-f1d2752445cd Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 is not attached to volume a4176998-10ad-4b3e-9ddd-f1d2752445cd Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:47.545540 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Returning 404 to user: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 is not attached to volume a4176998-10ad-4b3e-9ddd-f1d2752445cd {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:29:47.546768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-05edde0a-13a1-46e7-bf52-c28b6bc290e1 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments/a4176998-10ad-4b3e-9ddd-f1d2752445cd" status: 404 len: 154 microversion: 2.1 time: 0.093634 Aug 24 08:29:47.546768 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1280/2629] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 24 08:29:47 2022] DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056/os-volume_attachments/a4176998-10ad-4b3e-9ddd-f1d2752445cd => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:29:47.775736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe8d16b4-3e1b-40bf-a3eb-b3aa9ef0bbb7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:47.825152 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe8d16b4-3e1b-40bf-a3eb-b3aa9ef0bbb7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053327 Aug 24 08:29:47.825718 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1350/2630] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:48.829451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:48.829944 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:48.836326 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:48.836830 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:48.837252 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:48.837941 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:48.838362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:48.838772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:48.839978 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-da6e07da-00eb-489d-90b1-4eae47771a99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:48.864676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:29:48.887025 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-da6e07da-00eb-489d-90b1-4eae47771a99 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051643 Aug 24 08:29:48.887605 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1351/2631] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:49.134479 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b8435af-467a-4432-b067-8807937f1066 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 204 len: 0 microversion: 2.1 time: 0.308942 Aug 24 08:29:49.135051 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1281/2632] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:29:48 2022] DELETE /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:29:49.143691 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:49.144298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:49.151043 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:49.151518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:49.151946 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:49.152625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:49.153101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:49.153518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:49.288331 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:49.296537 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d803618-910f-4c0e-b8ac-01c88e7b506d tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1554 microversion: 2.1 time: 0.157255 Aug 24 08:29:49.297465 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1352/2633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:49 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:49.901632 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2533e30c-8bc6-4065-97bf-38c5b4d2ba28 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc19d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:49.948860 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2533e30c-8bc6-4065-97bf-38c5b4d2ba28 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051467 Aug 24 08:29:49.949429 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1282/2634] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:50.317744 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:50.318352 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:50.325084 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:50.325555 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:50.326008 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:50.326711 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:50.327151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:50.327559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:50.457089 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:50.464619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f90e6fe8-73b4-41e1-b71f-718f02737714 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1554 microversion: 2.1 time: 0.151309 Aug 24 08:29:50.465201 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1353/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:50 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:50.963946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e2cfccee-5b4f-4633-809d-8ad58c5a53e3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d055e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:51.011361 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e2cfccee-5b4f-4633-809d-8ad58c5a53e3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051728 Aug 24 08:29:51.012078 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1283/2636] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:51.486988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:51.486988 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:51.494558 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:51.494972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:51.495562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:51.496265 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:51.496742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:51.497160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:51.770069 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:51.778260 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6d6ba1b-5454-452c-8569-e5c251754b77 tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1554 microversion: 2.1 time: 0.296202 Aug 24 08:29:51.781474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1354/2637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:51 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:29:52.026660 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7a4e04e-e1c4-4b0f-9ee1-4c3bd6af8534 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:52.085172 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7a4e04e-e1c4-4b0f-9ee1-4c3bd6af8534 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.063191 Aug 24 08:29:52.085775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1284/2638] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:52.114061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f33c236-ca2a-4a2e-8c90-80b364c8f056", "name": "network-vif-deleted", "tag": "0a7a223a-ea0d-428f-9eef-3386d0b294d6"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:29:52.123474 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:52.123939 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:52.124367 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:52.141983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] Creating event network-vif-deleted:0a7a223a-ea0d-428f-9eef-3386d0b294d6 for instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 on hv-cinder-85427 Aug 24 08:29:52.141983 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-4804a73a-b163-468f-8fee-3540202d0745 req-072e44e4-dd7f-47b0-ad84-c173f45c9e31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030622 Aug 24 08:29:52.142748 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1355/2639] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:52.800171 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:52.800918 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:52.807087 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:52.807550 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:52.807972 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:52.808659 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:52.809104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:52.809523 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:52.841271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:52.841737 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:52.842159 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:52.846967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lazy-loading 'fault' on Instance uuid 8f33c236-ca2a-4a2e-8c90-80b364c8f056 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:29:52.889506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600f62677d437ead57459e3cf75e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a004d608f2454cb5e9e65eef5ed740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:29:52.901952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f27b5366-b3b7-49eb-b184-5a623f6656cb tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 200 len: 1348 microversion: 2.1 time: 0.103643 Aug 24 08:29:52.901952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1285/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:52 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:29:53.100010 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0649d80f-d5bf-4c70-b5b6-1ce3eb8faf0e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:53.150606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0649d80f-d5bf-4c70-b5b6-1ce3eb8faf0e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054643 Aug 24 08:29:53.151232 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1356/2641] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:53.921060 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:53.921664 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [instance: 8f33c236-ca2a-4a2e-8c90-80b364c8f056] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:29:53.927869 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:53.928351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:53.928819 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:53.929506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:29:53.929953 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:29:53.930373 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:29:53.944295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] HTTP exception thrown: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Request method failure captured: Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 HTTP/1.1 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Host: 10.222.0.26 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBeC9RycHhHAqlNcH-IvLMZhPtLer_O7HqHA0Zv6jYBzaCiGkoVg-D666i4hgK80xViAVsi3b3Iy54F9iaW_cyaWn2e4GHw6x20SNrDePdLB5rQD2PZgOyxFQ55frIHIJNwc02kJSxLgGpQPxfLX1_UZ8K6raDdm6LFSjo4kjM-8jYq8 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Id: 19a004d608f2454cb5e9e65eef5ed740 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 08:29:53.945984 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19a004d608f2454cb5e9e65eef5ed740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19a004d608f2454cb5e9e65eef5ed740"}]}] Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 19a004d608f2454cb5e9e65eef5ed740 Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2081517431 Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User: tempest-TestMinimumBasicScenario-2081517431-project Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Id: b5600f62677d437ead57459e3cf75e41 Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-TestMinimumBasicScenario-2081517431-project Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: method: > Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: exception: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. Aug 24 08:29:53.947185 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: action_args: {'id': '8f33c236-ca2a-4a2e-8c90-80b364c8f056'} Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:29:53.947833 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. Aug 24 08:29:53.948856 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 08:29:53.950041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Returning 404 to user: Instance 8f33c236-ca2a-4a2e-8c90-80b364c8f056 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:29:53.950041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-762643ba-0f8c-4a55-9402-911c5f11e51e tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056" status: 404 len: 111 microversion: 2.1 time: 0.029988 Aug 24 08:29:53.950041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1286/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:29:53 2022] GET /compute/v2.1/servers/8f33c236-ca2a-4a2e-8c90-80b364c8f056 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:29:53.956554 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-88230c21-5cd4-4a08-97c3-4ada92054bec tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] Calling method '.version_select at 0x7f456b6ea430>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:53.960909 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-88230c21-5cd4-4a08-97c3-4ada92054bec tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:29:54.164362 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4498977d-8efb-43fb-8203-ff504fd8ab6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:54.213011 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4498977d-8efb-43fb-8203-ff504fd8ab6e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052289 Aug 24 08:29:54.213568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1287/2643] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:29:54.968511 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [None req-88230c21-5cd4-4a08-97c3-4ada92054bec tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] [6f4eeedb-9a03-4fa9-b549-ad8d1d3bdf20] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40198. Aug 24 08:29:55.082442 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-88230c21-5cd4-4a08-97c3-4ada92054bec tempest-TestMinimumBasicScenario-2081517431 tempest-TestMinimumBasicScenario-2081517431-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1265034099" status: 202 len: 0 microversion: 2.1 time: 1.130076 Aug 24 08:29:55.082980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1357/2644] 10.222.0.26 () {58 vars in 1272 bytes} [Wed Aug 24 08:29:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1265034099 => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:29:55.227203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-27fa8257-ebdb-4a09-8999-bfb300ab8ee1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc10d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:55.275350 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-27fa8257-ebdb-4a09-8999-bfb300ab8ee1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052429 Aug 24 08:29:55.275931 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1288/2645] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:56.289743 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-019de913-3bce-4c6b-867d-3d6085c05874 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ea5e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:56.337727 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-019de913-3bce-4c6b-867d-3d6085c05874 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052272 Aug 24 08:29:56.338292 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1358/2646] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:57.351587 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1668ad82-7ce9-4280-b936-2e8798c73e38 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:57.405952 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1668ad82-7ce9-4280-b936-2e8798c73e38 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.058639 Aug 24 08:29:57.406554 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1289/2647] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:58.421251 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-54673f36-68a5-4983-81b4-be9bf01eb621 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:58.482413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-54673f36-68a5-4983-81b4-be9bf01eb621 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.065674 Aug 24 08:29:58.483242 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1359/2648] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:29:59.497269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-53a08300-f6c7-43fd-89dd-b41320d76cea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9ab80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:29:59.567623 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-53a08300-f6c7-43fd-89dd-b41320d76cea tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.074102 Aug 24 08:29:59.568170 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1290/2649] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:29:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:00.582505 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-15edcb0c-25a0-4faa-b2a1-fb1c99ea8d73 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b63eaf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:00.631414 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-15edcb0c-25a0-4faa-b2a1-fb1c99ea8d73 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054016 Aug 24 08:30:00.631980 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1360/2650] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:01.645705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-794157e5-3d47-48f1-9215-b23f8ea19759 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec8b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:01.704384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-794157e5-3d47-48f1-9215-b23f8ea19759 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.062510 Aug 24 08:30:01.705089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1291/2651] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:02.715841 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell1:SELECT=56 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:30:02.720836 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-18f97649-087e-4692-9804-28397c570957 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:02.787736 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-18f97649-087e-4692-9804-28397c570957 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.073174 Aug 24 08:30:02.788307 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1361/2652] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:03.803372 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-16e90722-6915-4b41-b00e-7684b0b4ae43 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:03.849821 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-16e90722-6915-4b41-b00e-7684b0b4ae43 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050717 Aug 24 08:30:03.850441 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1292/2653] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:04.865413 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-cbc20adf-f326-4c84-a7c5-606d216c2867 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bdc0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:04.921742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-cbc20adf-f326-4c84-a7c5-606d216c2867 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.061674 Aug 24 08:30:04.923534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1362/2654] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:05.931989 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:30:05.932912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:30:05.938502 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c865a81a-c7b6-447e-8fe1-6b61f1be90fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:05.990487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c865a81a-c7b6-447e-8fe1-6b61f1be90fc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.059180 Aug 24 08:30:05.991053 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1293/2655] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:07.004357 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5d80e6a4-a6bd-4fc0-87e2-65b16d243f9b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d978b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:07.011632 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:30:07.055358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5d80e6a4-a6bd-4fc0-87e2-65b16d243f9b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055307 Aug 24 08:30:07.055937 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1363/2656] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:08.070341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-47c8b7aa-365b-45cb-84c2-70b8977cd3cc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:08.118491 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-47c8b7aa-365b-45cb-84c2-70b8977cd3cc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052485 Aug 24 08:30:08.119054 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1294/2657] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:09.133023 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bcb27cc2-a1dd-40c8-bd6b-7f4e4e41d1f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:09.179705 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bcb27cc2-a1dd-40c8-bd6b-7f4e4e41d1f8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051243 Aug 24 08:30:09.180271 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1364/2658] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:10.194518 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f942d1db-4566-4edf-ac28-5ae12a6dd199 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:10.241985 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f942d1db-4566-4edf-ac28-5ae12a6dd199 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051766 Aug 24 08:30:10.244977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1295/2659] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:11.256672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-96704e43-54b4-49ea-9574-af229a7a195c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d973a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:11.303160 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-96704e43-54b4-49ea-9574-af229a7a195c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051055 Aug 24 08:30:11.303733 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1365/2660] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:12.316271 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8ff3416-cf30-4118-ae71-ee03f806f79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c055e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:12.367417 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8ff3416-cf30-4118-ae71-ee03f806f79f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055356 Aug 24 08:30:12.367975 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1296/2661] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:13.381566 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49ef21ef-5aeb-45b9-9384-37ae702d190d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:13.427510 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49ef21ef-5aeb-45b9-9384-37ae702d190d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050235 Aug 24 08:30:13.428065 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1366/2662] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:14.441056 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f68089a8-bff0-47b5-bd64-15de6ff27e4c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9aca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:14.487317 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f68089a8-bff0-47b5-bd64-15de6ff27e4c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050791 Aug 24 08:30:14.487877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1297/2663] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:15.502130 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1511f126-0a80-40f2-ad05-7bad6fe0a5ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d831f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:15.549677 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1511f126-0a80-40f2-ad05-7bad6fe0a5ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052525 Aug 24 08:30:15.550241 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1367/2664] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:16.564138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c5183ac-a615-418c-bb81-b8bc037b2b05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec3a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:16.610777 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c5183ac-a615-418c-bb81-b8bc037b2b05 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051368 Aug 24 08:30:16.611342 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1298/2665] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:17.624938 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dd3f9152-655e-4b00-909f-a9b31681ce3d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc5e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:17.672106 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dd3f9152-655e-4b00-909f-a9b31681ce3d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051334 Aug 24 08:30:17.672685 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1368/2666] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:18.686144 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ec24038-47fd-40a7-bf96-23bede1c8afa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:18.731862 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ec24038-47fd-40a7-bf96-23bede1c8afa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049985 Aug 24 08:30:18.732418 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1299/2667] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:19.746678 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-c730a39c-2bc7-4e78-9ab6-024efcd0e9a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ea820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:19.792018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-c730a39c-2bc7-4e78-9ab6-024efcd0e9a1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049633 Aug 24 08:30:19.792576 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1369/2668] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:20.807237 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-083a2be5-108c-4fb6-89fc-c6a273f7989e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:20.853250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-083a2be5-108c-4fb6-89fc-c6a273f7989e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050382 Aug 24 08:30:20.870722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1300/2669] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:21.867993 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-4d8d8b3c-6816-482e-9d8d-a9faa571d8ba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:21.914411 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-4d8d8b3c-6816-482e-9d8d-a9faa571d8ba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050696 Aug 24 08:30:21.914989 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1370/2670] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:22.928295 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fcf967dc-6383-4090-b3eb-b99bb6b1cc06 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c9a820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:22.974825 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fcf967dc-6383-4090-b3eb-b99bb6b1cc06 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050764 Aug 24 08:30:22.975380 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1301/2671] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:23.205898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:30:23.206398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:30:23.989609 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5caac19b-1f05-494a-90ef-6b2d9911a202 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:24.034436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5caac19b-1f05-494a-90ef-6b2d9911a202 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049147 Aug 24 08:30:24.035018 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1371/2672] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:25.048489 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c0b2e769-329e-438f-be51-cdf2a28d5ba6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:25.094497 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c0b2e769-329e-438f-be51-cdf2a28d5ba6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050964 Aug 24 08:30:25.095058 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1302/2673] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:26.109363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8ce13099-d223-4469-bdf9-b27dd92c935a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:26.153798 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8ce13099-d223-4469-bdf9-b27dd92c935a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049541 Aug 24 08:30:26.154343 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1372/2674] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:27.168261 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc74b86f-8928-46be-94ac-51637511bb5a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc10d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:27.214337 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc74b86f-8928-46be-94ac-51637511bb5a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050648 Aug 24 08:30:27.214889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1303/2675] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:28.230987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3b442749-4a81-42aa-995c-54042a2b5ef0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d98af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:28.280801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3b442749-4a81-42aa-995c-54042a2b5ef0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052551 Aug 24 08:30:28.280801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1373/2676] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:29.291561 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7b7caa1-520d-4fe1-a101-d5a2eb9383b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05820>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:29.351584 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7b7caa1-520d-4fe1-a101-d5a2eb9383b7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.064478 Aug 24 08:30:29.352228 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1304/2677] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:30.660439 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e6fa3b25-a356-4610-b3fe-4aaba416a7f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:30.706412 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e6fa3b25-a356-4610-b3fe-4aaba416a7f3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.343846 Aug 24 08:30:30.706979 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1374/2678] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:31.721055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58436ede-cb32-4419-9e59-efe791673a2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:31.767628 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58436ede-cb32-4419-9e59-efe791673a2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051561 Aug 24 08:30:31.768283 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1305/2679] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:32.781506 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7954206d-21fe-446f-9f38-fcab14187eca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b728040>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:32.827562 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7954206d-21fe-446f-9f38-fcab14187eca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050389 Aug 24 08:30:32.828124 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1375/2680] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:33.037369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:30:33.037904 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:30:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:30:33.841549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8a8e050c-156a-42a4-b8e0-3701ac2279ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cecaf0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:33.886990 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8a8e050c-156a-42a4-b8e0-3701ac2279ab tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049608 Aug 24 08:30:33.887558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1306/2681] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:34.901923 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-ac5ef516-ee4a-4a5c-97db-348bc2e720df tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6c5f70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:34.948042 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-ac5ef516-ee4a-4a5c-97db-348bc2e720df tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050367 Aug 24 08:30:34.948608 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1376/2682] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:35.962562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56ae2298-f797-4ba8-82bf-183dca872149 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cba790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:36.009864 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56ae2298-f797-4ba8-82bf-183dca872149 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051571 Aug 24 08:30:36.010425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1307/2683] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:37.023700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3bcee03b-1853-4df5-b9af-4e494c76d4bd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d970d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:37.071230 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3bcee03b-1853-4df5-b9af-4e494c76d4bd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051719 Aug 24 08:30:37.071788 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1377/2684] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:38.085798 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d2ad9a4f-1ddb-4ec6-b949-32d115dd342c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:38.130874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d2ad9a4f-1ddb-4ec6-b949-32d115dd342c tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049379 Aug 24 08:30:38.131421 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1308/2685] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:39.144972 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-df1c5bb0-5ad3-4c6f-ac68-14a4af2a040a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b728a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:39.191656 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-df1c5bb0-5ad3-4c6f-ac68-14a4af2a040a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051003 Aug 24 08:30:39.192211 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1378/2686] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:40.205097 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e56ea1d-5a23-44f7-b011-b730e9f10624 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:40.251775 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e56ea1d-5a23-44f7-b011-b730e9f10624 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050949 Aug 24 08:30:40.252338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1309/2687] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:41.266435 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-27c9599a-fc9c-468f-ba91-0c50e48b4620 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6eac10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:41.314969 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-27c9599a-fc9c-468f-ba91-0c50e48b4620 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053457 Aug 24 08:30:41.315540 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1379/2688] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:42.330240 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-980d0771-fd4b-481d-905b-2d30f0a0d235 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c790>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:42.375673 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-980d0771-fd4b-481d-905b-2d30f0a0d235 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050752 Aug 24 08:30:42.376222 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1310/2689] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:43.389772 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-8f9e93d7-fdda-42b4-93c4-e378a5a3b9f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71bf70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:43.436161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-8f9e93d7-fdda-42b4-93c4-e378a5a3b9f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050723 Aug 24 08:30:43.438363 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1380/2690] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:44.450272 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-877c0157-4061-476a-9ef5-439448dad326 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d050d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:44.495423 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-877c0157-4061-476a-9ef5-439448dad326 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049412 Aug 24 08:30:44.495981 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1311/2691] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:45.510330 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a0311eb6-609a-4f7e-9f36-b9d2f2d99a8b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6de1f0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:45.556747 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a0311eb6-609a-4f7e-9f36-b9d2f2d99a8b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050743 Aug 24 08:30:45.557325 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1381/2692] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:46.571269 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a1d8429-c1a0-47a6-be68-ca9ae3f791d6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc1670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:46.618506 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a1d8429-c1a0-47a6-be68-ca9ae3f791d6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051515 Aug 24 08:30:46.619074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1312/2693] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:46 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:47.631676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-40ed13e6-785e-4530-bea8-60a684cf8551 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74baf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:47.676953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-40ed13e6-785e-4530-bea8-60a684cf8551 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049433 Aug 24 08:30:47.677535 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1382/2694] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:48.691451 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-69a34c7c-7b37-441f-935e-ffd2281b497d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40550>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:48.737524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-69a34c7c-7b37-441f-935e-ffd2281b497d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050675 Aug 24 08:30:48.738104 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1313/2695] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:49.752213 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-49a453ed-f299-489b-a286-8eba21861bbd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d970d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:49.797837 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-49a453ed-f299-489b-a286-8eba21861bbd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050674 Aug 24 08:30:49.798398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1383/2696] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:50.812173 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f45badb0-2940-4b37-a0de-e2c6f534f30e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:50.857558 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f45badb0-2940-4b37-a0de-e2c6f534f30e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050182 Aug 24 08:30:50.858169 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1314/2697] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:51.871750 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-6d516b2c-f705-4d3f-b19a-96d92c2373a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6dec10>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:51.919200 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-6d516b2c-f705-4d3f-b19a-96d92c2373a0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051809 Aug 24 08:30:51.919801 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1384/2698] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:52.933412 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-173961f2-b8ec-4226-b52f-b7ca98f72cdf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713e50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:52.979845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-173961f2-b8ec-4226-b52f-b7ca98f72cdf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050928 Aug 24 08:30:52.980428 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1315/2699] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:53.994151 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-712d15a6-0c62-470f-885c-77df92fabd9f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:54.039862 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-712d15a6-0c62-470f-885c-77df92fabd9f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049734 Aug 24 08:30:54.040424 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1385/2700] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:30:55.054357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b2ee7671-a738-4853-904e-220ba431adac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:55.105657 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b2ee7671-a738-4853-904e-220ba431adac tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.055650 Aug 24 08:30:55.106221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1316/2701] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:56.120492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1abf203d-2403-44bf-b1b3-3d27f1f199d2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5af0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:56.166629 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1abf203d-2403-44bf-b1b3-3d27f1f199d2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050414 Aug 24 08:30:56.167183 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1386/2702] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:57.180385 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e4fbb9ff-3bb1-4e77-9368-12d36091454b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7134c0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:57.235997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e4fbb9ff-3bb1-4e77-9368-12d36091454b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051005 Aug 24 08:30:57.235997 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1317/2703] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:58.241483 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-07069ca0-da46-42f6-b746-195dc82c14ee tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74baf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:58.288880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-07069ca0-da46-42f6-b746-195dc82c14ee tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051734 Aug 24 08:30:58.289704 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1387/2704] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:30:59.303772 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fc187856-55fb-41ea-9917-a3d93e16d86d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cecd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:30:59.350865 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fc187856-55fb-41ea-9917-a3d93e16d86d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051455 Aug 24 08:30:59.351420 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1318/2705] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:30:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:00.364953 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a53c0ede-045a-4b20-b94e-78a4020d6939 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:00.410804 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a53c0ede-045a-4b20-b94e-78a4020d6939 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050164 Aug 24 08:31:00.411471 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1388/2706] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:01.425840 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0f6f4034-93be-4614-9804-2b51a7dd8a54 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680383a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:01.472331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0f6f4034-93be-4614-9804-2b51a7dd8a54 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051289 Aug 24 08:31:01.473055 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1319/2707] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:02.487060 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-e2442354-c619-43c2-a688-566cd2c8ccd5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b280>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:02.532358 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-e2442354-c619-43c2-a688-566cd2c8ccd5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050366 Aug 24 08:31:02.533031 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1389/2708] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:03.546676 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9046552d-3c0b-4f92-9d99-67655030e145 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc1040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:03.593050 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9046552d-3c0b-4f92-9d99-67655030e145 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050770 Aug 24 08:31:03.596970 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1320/2709] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:03 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:04.606467 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9aa814bd-4489-432d-b58b-c4dca7f6b7b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:04.652545 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9aa814bd-4489-432d-b58b-c4dca7f6b7b3 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050386 Aug 24 08:31:04.653223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1390/2710] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:05.667512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f02ff4f4-1e7f-40db-8dde-0e1eee33e31d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713f70>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:05.713103 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f02ff4f4-1e7f-40db-8dde-0e1eee33e31d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050038 Aug 24 08:31:05.713666 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1321/2711] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:06.727599 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2b43f951-9dbb-4501-8ff7-5ee4e2608e01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:06.773643 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2b43f951-9dbb-4501-8ff7-5ee4e2608e01 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050477 Aug 24 08:31:06.774223 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1391/2712] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:07.788341 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6b5c674e-31a0-4afb-886f-6aaeae348a10 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c735e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:07.834181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6b5c674e-31a0-4afb-886f-6aaeae348a10 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050071 Aug 24 08:31:07.834742 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1322/2713] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:08.848492 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-09cb1507-996f-4bff-83a7-373ce6b1a70d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b5e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:08.893453 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-09cb1507-996f-4bff-83a7-373ce6b1a70d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049662 Aug 24 08:31:08.894005 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1392/2714] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:09.907487 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d0d14960-f4cd-4802-a4a6-18efcd6bda37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:09.953792 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d0d14960-f4cd-4802-a4a6-18efcd6bda37 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050560 Aug 24 08:31:09.954339 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1323/2715] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:10.967780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-feea490f-4956-4720-8ffb-c51d0820ef0b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d83790>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:11.014351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-feea490f-4956-4720-8ffb-c51d0820ef0b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050854 Aug 24 08:31:11.015030 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1393/2716] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:12.029236 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f8af1f9c-bd0b-407f-ab05-c0f0c0f77a46 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec940>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:12.079684 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f8af1f9c-bd0b-407f-ab05-c0f0c0f77a46 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.054683 Aug 24 08:31:12.080288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1324/2717] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:13.093676 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9a5715f3-686b-4de6-a74d-bd1c978ccf24 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bcee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:13.138943 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9a5715f3-686b-4de6-a74d-bd1c978ccf24 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049637 Aug 24 08:31:13.139504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1394/2718] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:14.152152 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-38111218-9286-46e6-9994-2d6f52e1728d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c73280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:14.199672 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-38111218-9286-46e6-9994-2d6f52e1728d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051072 Aug 24 08:31:14.200242 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1325/2719] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:15.214436 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-56f5f841-bfb6-4271-b3dd-4b9757f540c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71bf70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:15.259738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-56f5f841-bfb6-4271-b3dd-4b9757f540c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049654 Aug 24 08:31:15.260285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1395/2720] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:16.274928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef9b93fc-dc9b-45e8-a0b7-b8f6bf2ba163 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c401f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:16.321244 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef9b93fc-dc9b-45e8-a0b7-b8f6bf2ba163 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050505 Aug 24 08:31:16.321818 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1326/2721] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:17.335055 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-15fce173-4f30-4ebb-b18e-8514a1179d2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72ff70>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:17.381078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-15fce173-4f30-4ebb-b18e-8514a1179d2f tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050220 Aug 24 08:31:17.381659 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1396/2722] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:18.395680 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5cee7bc-9d7e-4bc6-a34b-9d10df95f582 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c040>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:18.442402 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5cee7bc-9d7e-4bc6-a34b-9d10df95f582 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050915 Aug 24 08:31:18.443068 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1327/2723] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:31:19.455808 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a90765e7-f2f5-4ce7-8736-71b5ed2473a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:19.501654 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a90765e7-f2f5-4ce7-8736-71b5ed2473a8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050173 Aug 24 08:31:19.502263 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1397/2724] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:20.515740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7990a7ba-fac7-486c-a890-89966eb9265a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b713ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:20.563384 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7990a7ba-fac7-486c-a890-89966eb9265a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052081 Aug 24 08:31:20.563946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1328/2725] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:21.578356 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-1ce1b254-af7d-40b5-b597-645af5966744 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:21.623086 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-1ce1b254-af7d-40b5-b597-645af5966744 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049889 Aug 24 08:31:21.623651 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1398/2726] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:21 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:22.637719 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ba6c067d-061e-4fda-b8d3-1e454a83d696 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:22.684534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ba6c067d-061e-4fda-b8d3-1e454a83d696 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050955 Aug 24 08:31:22.685127 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1329/2727] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:23.698893 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f02c1621-0e53-4b85-9485-1687e06391d4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6c58b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:23.744903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f02c1621-0e53-4b85-9485-1687e06391d4 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050187 Aug 24 08:31:23.745460 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1399/2728] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:24.759928 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d2483294-465b-4d9b-9d27-f46798cbb7fd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680385e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:24.805871 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d2483294-465b-4d9b-9d27-f46798cbb7fd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050245 Aug 24 08:31:24.806459 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1330/2729] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:25.819573 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f5b208b9-89ab-44cd-a1f0-51358dd070cc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:25.865581 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f5b208b9-89ab-44cd-a1f0-51358dd070cc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050338 Aug 24 08:31:25.866149 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1400/2730] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:26.879512 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2347a8fb-8d54-4a74-aa59-bfaa4c1e7391 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b7130d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:26.926360 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2347a8fb-8d54-4a74-aa59-bfaa4c1e7391 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051059 Aug 24 08:31:26.926914 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1331/2731] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:27.940087 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5b9fc686-a395-47b8-9673-bd790c5fece8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:27.985771 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5b9fc686-a395-47b8-9673-bd790c5fece8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050162 Aug 24 08:31:27.986318 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1401/2732] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:29.000331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-81536012-4df5-4a0c-a71d-c1adcdce2138 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:29.046480 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-81536012-4df5-4a0c-a71d-c1adcdce2138 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050588 Aug 24 08:31:29.047067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1332/2733] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:30.060574 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9ad56326-8807-4b40-a62d-1b298381d0c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97940>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:30.110239 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9ad56326-8807-4b40-a62d-1b298381d0c6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053831 Aug 24 08:31:30.110987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1402/2734] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:31:31.123957 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d520bc8f-b43f-484e-ac83-58be8ca517bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5c670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:31.169613 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d520bc8f-b43f-484e-ac83-58be8ca517bf tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050174 Aug 24 08:31:31.170199 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1333/2735] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:31 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:32.183831 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d71f50ac-532c-4885-a64e-88209253ff08 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:32.229896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d71f50ac-532c-4885-a64e-88209253ff08 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050454 Aug 24 08:31:32.230456 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1403/2736] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:32 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:33.243913 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-923a6f2b-e7b0-4671-b40e-880ec4f461b0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:33.293439 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-923a6f2b-e7b0-4671-b40e-880ec4f461b0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053948 Aug 24 08:31:33.293993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1334/2737] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:33 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:34.307649 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-203fd119-7a00-4f24-b241-10ac00b6f4fe tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:34.353625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-203fd119-7a00-4f24-b241-10ac00b6f4fe tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050302 Aug 24 08:31:34.354206 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1404/2738] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:34 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:35.367889 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a5872956-9fcd-486c-823f-8e83cbb1c1c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cb80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:35.414528 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a5872956-9fcd-486c-823f-8e83cbb1c1c9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051018 Aug 24 08:31:35.415088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1335/2739] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:35 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:36.429694 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-fe3842b3-9402-4733-8d26-c452133423a9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:36.486021 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-fe3842b3-9402-4733-8d26-c452133423a9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.060775 Aug 24 08:31:36.488560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1405/2740] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:36 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:37.500006 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bea39d61-e9c2-46e3-b089-102ab0b3b4c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4568038ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:37.546872 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bea39d61-e9c2-46e3-b089-102ab0b3b4c5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051328 Aug 24 08:31:37.547440 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1336/2741] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:37 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:38.561822 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a6e6e8c7-b655-418f-b268-f0bc4c28ab3b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:38.609828 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a6e6e8c7-b655-418f-b268-f0bc4c28ab3b tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053160 Aug 24 08:31:38.610398 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1406/2742] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:38 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:39.623845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa3f3a70-849c-491b-a49b-68105718d437 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cbac10>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:39.671585 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa3f3a70-849c-491b-a49b-68105718d437 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052030 Aug 24 08:31:39.672349 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1337/2743] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:39 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:40.685922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-bca0635e-9183-49a8-b506-92cd25376a13 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b3a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:40.732470 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-bca0635e-9183-49a8-b506-92cd25376a13 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050689 Aug 24 08:31:40.733256 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1407/2744] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:40 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:41.746359 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7cd674c5-690d-4c82-b7ab-df9c4b240815 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:41.793181 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7cd674c5-690d-4c82-b7ab-df9c4b240815 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051048 Aug 24 08:31:41.793923 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1338/2745] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:41 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:42.807706 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-b702a8e6-7075-42b3-b6e6-1d2197b11100 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ea820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:42.857524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-b702a8e6-7075-42b3-b6e6-1d2197b11100 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052202 Aug 24 08:31:42.857524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1408/2746] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:42 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:43.869723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cf4e6761-6c77-4f52-b71b-d700cc061c7d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:43.915974 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cf4e6761-6c77-4f52-b71b-d700cc061c7d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050354 Aug 24 08:31:43.916526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1339/2747] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:43 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:44.929903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-a092dc1e-52ad-4acf-a4c2-845f4aac2f3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6bc0d0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:44.974859 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-a092dc1e-52ad-4acf-a4c2-845f4aac2f3a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049130 Aug 24 08:31:44.975441 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1409/2748] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:44 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:45.989197 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-17b61a93-2f07-41f0-bf9b-1f9e06ac9635 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d05ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:46.035549 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-17b61a93-2f07-41f0-bf9b-1f9e06ac9635 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050688 Aug 24 08:31:46.036118 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1340/2749] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:45 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:47.050504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f86c9f42-5e1e-4d38-91ba-4452475124f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:47.096497 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f86c9f42-5e1e-4d38-91ba-4452475124f9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050165 Aug 24 08:31:47.098003 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1410/2750] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:47 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:48.111912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8a53f27f-b637-4902-9cfd-9be9e0bb6948 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c401f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:48.157815 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8a53f27f-b637-4902-9cfd-9be9e0bb6948 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050846 Aug 24 08:31:48.158369 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1341/2751] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:48 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:49.172280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-290e4564-dcdb-42d3-a33d-9c64d60225a2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ead30>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:49.219024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-290e4564-dcdb-42d3-a33d-9c64d60225a2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050589 Aug 24 08:31:49.219592 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1411/2752] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:49 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:50.233088 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2509bfff-a357-46b4-89ec-5bf684f46d51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680389d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:50.280969 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2509bfff-a357-46b4-89ec-5bf684f46d51 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051500 Aug 24 08:31:50.281723 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1342/2753] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:50 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:51.295430 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-00f1c732-cc1e-4af3-bc06-2af408fcb68d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6c53a0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:51.341078 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-00f1c732-cc1e-4af3-bc06-2af408fcb68d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049854 Aug 24 08:31:51.341639 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1412/2754] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:51 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:52.355138 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-540374cc-c639-41bc-9c0d-6bc73004888d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cec310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:52.402219 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-540374cc-c639-41bc-9c0d-6bc73004888d tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051445 Aug 24 08:31:52.402782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1343/2755] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:52 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:53.417300 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2e3d1dbf-1924-45df-bf11-4aff94540aa6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d8d550>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:53.463572 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2e3d1dbf-1924-45df-bf11-4aff94540aa6 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050792 Aug 24 08:31:53.464141 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1413/2756] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:53 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:54.477524 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b09d2972-32aa-47c2-8b64-5a5294f2bae8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c408b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:54.524041 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b09d2972-32aa-47c2-8b64-5a5294f2bae8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050759 Aug 24 08:31:54.524603 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1344/2757] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:54 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:55.538625 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0281c034-3214-4224-910a-22088f70ddcc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b750700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:55.587438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0281c034-3214-4224-910a-22088f70ddcc tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051399 Aug 24 08:31:55.587438 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1414/2758] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:55 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:56.599946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6ffb046f-b111-4e1f-98f0-4c5fc0f67f8e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cb80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:56.646541 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6ffb046f-b111-4e1f-98f0-4c5fc0f67f8e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051174 Aug 24 08:31:56.647100 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1345/2759] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:56 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:57.660696 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-30dd48b1-2ecb-4649-9f4f-5ede8118a9ef tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b74b4c0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:57.708351 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-30dd48b1-2ecb-4649-9f4f-5ede8118a9ef tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052099 Aug 24 08:31:57.708947 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1415/2760] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:57 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:58.722908 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d020bb26-09ea-4fe7-85d0-e2eb1c3ed26a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b644670>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:58.768615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d020bb26-09ea-4fe7-85d0-e2eb1c3ed26a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050456 Aug 24 08:31:58.769227 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1346/2761] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:58 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:31:59.782737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-9550fd99-559b-44af-a662-8214e41b1e26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6eaee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:31:59.828169 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-9550fd99-559b-44af-a662-8214e41b1e26 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050437 Aug 24 08:31:59.828755 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1416/2762] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:31:59 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:00.842120 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6e90a1e6-f9fb-4913-8481-391a2d4c06a7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c40700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:00.888023 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6e90a1e6-f9fb-4913-8481-391a2d4c06a7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050063 Aug 24 08:32:00.888600 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1347/2763] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:00 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:01.901950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3661537f-1225-43d2-ba60-2a48daf212a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b70c160>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:01.949061 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3661537f-1225-43d2-ba60-2a48daf212a5 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051384 Aug 24 08:32:01.949615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1417/2764] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:01 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:02.965694 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f3c9dfed-0be5-4634-8ab3-22811a43ced2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680385e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:03.011878 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f3c9dfed-0be5-4634-8ab3-22811a43ced2 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050517 Aug 24 08:32:03.012438 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1348/2765] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:02 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:04.025524 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7c6fd0ce-4835-4ac9-aadf-6cf104a13523 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97ca0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:04.071684 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7c6fd0ce-4835-4ac9-aadf-6cf104a13523 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050427 Aug 24 08:32:04.072237 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1418/2766] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:04 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:05.085592 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fde10c96-a606-4ff5-9af4-09627e7cecc7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cc1d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:05.131507 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fde10c96-a606-4ff5-9af4-09627e7cecc7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050137 Aug 24 08:32:05.132063 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1349/2767] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:05 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:06.145769 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3e7fceaa-af26-4cbb-911f-cedbee482400 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6a5a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:06.199319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3e7fceaa-af26-4cbb-911f-cedbee482400 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050177 Aug 24 08:32:06.199319 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1419/2768] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:06 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:07.206537 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-93d3fa53-0ef2-4771-b06a-e1a9f796e9ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680389d0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:07.253415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-93d3fa53-0ef2-4771-b06a-e1a9f796e9ca tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051847 Aug 24 08:32:07.253977 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1350/2769] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:07 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:08.267070 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-32b976d5-a580-4634-9d20-0c51752d94aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b70c670>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:08.316298 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-32b976d5-a580-4634-9d20-0c51752d94aa tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.053953 Aug 24 08:32:08.317041 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1420/2770] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:08 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:08.468949 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:32:08.469461 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:32:09.330740 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4309d984-605e-4e76-9879-c243ee5f3349 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5cd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:09.376351 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4309d984-605e-4e76-9879-c243ee5f3349 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050569 Aug 24 08:32:09.376958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1351/2771] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:09 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:10.391099 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-57a3b16a-32c2-4a51-9790-55f8379db0b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:10.437103 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-57a3b16a-32c2-4a51-9790-55f8379db0b8 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050377 Aug 24 08:32:10.437631 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1421/2772] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:10 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:32:11.450403 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a108f686-6afe-4e8d-85c5-a7a676097cc7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:11.495845 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a108f686-6afe-4e8d-85c5-a7a676097cc7 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049649 Aug 24 08:32:11.496398 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1352/2773] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:11 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:12.510615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-d98fe842-b3c8-454f-b2b9-cc0c4e6bf446 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d6bb80>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:12.556737 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-d98fe842-b3c8-454f-b2b9-cc0c4e6bf446 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050304 Aug 24 08:32:12.557303 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1422/2774] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:12 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:13.571437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c9570a6-0b7c-4e4b-8d63-03bd7bbddc87 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c05160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:13.617863 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c9570a6-0b7c-4e4b-8d63-03bd7bbddc87 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050705 Aug 24 08:32:13.618455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1353/2775] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:13 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:14.631589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-589818d4-0919-4e3f-a010-73cbfcf1c59a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72f8b0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:14.678582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-589818d4-0919-4e3f-a010-73cbfcf1c59a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051298 Aug 24 08:32:14.679253 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1423/2776] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:14 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:15.693338 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-40e4b5ef-183e-43dd-b69b-937f1cc57b2a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c738b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:15.740082 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-40e4b5ef-183e-43dd-b69b-937f1cc57b2a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051516 Aug 24 08:32:15.740690 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1354/2777] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:15 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:16.755001 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5cc86118-3595-4aae-8387-a94d63e361c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97820>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:16.800185 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5cc86118-3595-4aae-8387-a94d63e361c0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049495 Aug 24 08:32:16.800768 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1424/2778] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:16 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:17.814765 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6b716ee6-e3a7-4049-9d59-1835d35a9c24 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d18dc0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:17.859939 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6b716ee6-e3a7-4049-9d59-1835d35a9c24 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050064 Aug 24 08:32:17.860496 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1355/2779] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:17 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:18.875700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dfc2e270-ea25-4182-939f-10243bd2560e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b6ea700>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:18.921192 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dfc2e270-ea25-4182-939f-10243bd2560e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049957 Aug 24 08:32:18.921762 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1425/2780] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:18 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:19.935151 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae6ffab4-d364-42ce-b957-74b6b60e5cff tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5caf0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:19.980573 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae6ffab4-d364-42ce-b957-74b6b60e5cff tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049603 Aug 24 08:32:19.981168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1356/2781] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:19 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:20.892194 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:32:20.892392 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:32:20.994415 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-67370290-de1c-4170-b571-08b97913b2f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71b5e0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:21.040062 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-67370290-de1c-4170-b571-08b97913b2f0 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049865 Aug 24 08:32:21.040606 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1426/2782] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:20 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:22.055455 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8ec5f87-27a0-466d-9560-3578eca85bfd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c5ce50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:22.101662 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8ec5f87-27a0-466d-9560-3578eca85bfd tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051003 Aug 24 08:32:22.102224 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1357/2783] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:22 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:23.115776 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-39bcf2cd-81fb-40d4-a07c-508fb044c40a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97a60>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:23.161950 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-39bcf2cd-81fb-40d4-a07c-508fb044c40a tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050258 Aug 24 08:32:23.162504 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1427/2784] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:23 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:23.245589 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:32:23.245738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:32:24.176038 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8b52c782-aa7c-408f-8e67-46f81a8663ba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f45680385e0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:24.223211 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8b52c782-aa7c-408f-8e67-46f81a8663ba tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.051475 Aug 24 08:32:24.223774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1358/2785] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:24 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:25.238059 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-7f347c03-11f3-41c6-800d-af0582baaf62 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b72fee0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:25.283958 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-7f347c03-11f3-41c6-800d-af0582baaf62 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050195 Aug 24 08:32:25.284501 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1428/2786] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:25 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:32:26.298594 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-41a5af4a-2b2c-479c-ad94-4388962b751e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c73ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:26.344702 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-41a5af4a-2b2c-479c-ad94-4388962b751e tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050852 Aug 24 08:32:26.345268 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1359/2787] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:26 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:27.359560 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-94602a8b-ae74-4349-88a2-3954ff31ba91 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562d97310>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:27.405491 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-94602a8b-ae74-4349-88a2-3954ff31ba91 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050899 Aug 24 08:32:27.406056 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1429/2788] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:27 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:28.419894 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00b66273-ba2e-4bc1-a701-548b79e11da9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562cdbaf0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:28.467993 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00b66273-ba2e-4bc1-a701-548b79e11da9 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.052520 Aug 24 08:32:28.468568 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1360/2789] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:28 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:29.481360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-3daebc2f-8e8f-44e7-83c5-0a0c14751a96 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f456b71baf0>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:29.526918 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-3daebc2f-8e8f-44e7-83c5-0a0c14751a96 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.049937 Aug 24 08:32:29.527559 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1430/2790] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:29 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:32:30.541771 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b389fae-73ff-4d3c-88cc-895cfd7abab1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] Calling method '.version_select at 0x7f4562c73ca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:32:30.587946 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b389fae-73ff-4d3c-88cc-895cfd7abab1 tempest-VolumesSnapshotsTestJSON-646704247 tempest-VolumesSnapshotsTestJSON-646704247-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098" status: 200 len: 346 microversion: 2.1 time: 0.050398 Aug 24 08:32:30.588505 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1361/2791] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 24 08:32:30 2022] GET /compute/v2.1/os-volumes/89e3ad92-bf21-4703-9688-35c9e4486098 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:33:40.581739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-736915114", "imageRef": "2f126f55-d4a0-454b-ba0a-454e5f85a855", "flavorRef": "452"}} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:33:40.633057 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.network.neutron [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] validate_networks() for None {{(pid=132893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:33:40.902846 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Flavor limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:33:40.903258 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Image limits 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:33:40.903717 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Flavor pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:33:40.904119 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Image pref 0:0:0 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:33:40.904518 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.virt.hardware [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:33:40.913481 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:40.913945 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:40.914371 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:40.915074 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:40.915514 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:40.915922 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:40.932392 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Getting quotas for project bee8c1b48a704a41a6768092e0792177. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:33:40.936294 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.quota [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Getting quotas for user 188bf9f182844a138d8187428a12d9c4 and project bee8c1b48a704a41a6768092e0792177. Resources: {'instances', 'cores', 'ram'} {{(pid=132893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:33:40.947896 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Going to run 1 instances... {{(pid=132893) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:33:40.950361 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f126f55-d4a0-454b-ba0a-454e5f85a855',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:33:41.127350 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [b2351ee0-882a-4bc2-8b4c-45e59c1dbc96] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:33:42.134360 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [b2351ee0-882a-4bc2-8b4c-45e59c1dbc96] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41642. Aug 24 08:33:42.138226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-5f6a7e93-3295-4751-898e-35f3c5af4167 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562031 Aug 24 08:33:42.139032 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1431/2792] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 24 08:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:33:42.151677 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b024f54-b004-4009-be2e-40a26f1fe999 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:42.152281 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4b024f54-b004-4009-be2e-40a26f1fe999 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:42.206779 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4b024f54-b004-4009-be2e-40a26f1fe999 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:42.215331 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b024f54-b004-4009-be2e-40a26f1fe999 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1214 microversion: 2.1 time: 0.069642 Aug 24 08:33:42.215884 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1362/2793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:42 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:43.235855 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:43.236417 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:43.244063 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:43.246336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:43.246336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:43.246336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:43.246336 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:43.246702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:43.311049 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:43.320419 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-2c448983-0553-42f8-8fc2-86e8634ac34b tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1218 microversion: 2.1 time: 0.088946 Aug 24 08:33:43.321216 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1432/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:43 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:44.342806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:44.342806 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:44.349139 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:44.349612 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:44.350155 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:44.350947 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:44.351396 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:44.351813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:44.421912 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:44.431454 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a681a3f6-0359-49c9-b99e-216ba85cda5e tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1274 microversion: 2.1 time: 0.092856 Aug 24 08:33:44.432045 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1363/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:44 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:45.457701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:45.458285 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:45.465698 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:45.468212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:45.468212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:45.468212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:45.468212 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:45.468539 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:45.644700 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:45.653447 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-dc5b6a51-588f-4356-a91e-a6337904d4bd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.199785 Aug 24 08:33:45.654280 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1433/2796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:45 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:46.629495 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e5ff42-af84-4802-ac59-d1d74ac113ab", "tag": "23d11295-3e21-449f-bd20-e5a063016fcb"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:33:46.639510 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:46.639965 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:46.640388 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:46.652089 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] Creating event network-changed:23d11295-3e21-449f-bd20-e5a063016fcb for instance e5e5ff42-af84-4802-ac59-d1d74ac113ab on hv-cinder-85427 Aug 24 08:33:46.657966 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-778bb453-63c6-409d-8250-05e08c3c02d9 req-8118821d-d531-484b-bdfa-dccc8eb8518c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156964 Aug 24 08:33:46.658562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1364/2797] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:33:46.675058 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:46.675660 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:46.682619 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:46.683088 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:46.683508 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:46.684178 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:46.684616 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:46.686408 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:46.890898 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:46.899026 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-0d831a14-6074-41fc-bcbf-fb6a6455b6ec tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.227726 Aug 24 08:33:46.899607 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1434/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:46 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:47.920801 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:47.921534 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:47.927709 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:47.928189 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:47.928619 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:47.929425 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:47.929874 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:47.930292 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:48.060168 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:48.067832 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-93cb2d72-bd9a-47fa-882e-5e4098e98454 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.151701 Aug 24 08:33:48.068393 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1365/2799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:47 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:49.089250 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:49.089845 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:49.096161 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:49.096672 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:49.097101 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:49.097780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:49.098226 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:49.098675 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:49.232666 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:49.240203 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-18b5590a-6fea-4e64-a91e-67f1c9318721 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.155319 Aug 24 08:33:49.241354 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1435/2800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:49 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:50.260846 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:50.261483 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:50.267886 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:50.268353 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:50.268814 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:50.269499 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:50.269940 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:50.270366 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:50.396327 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:50.404486 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc433a9d-e309-47a7-a8f4-28c4153f719c tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.147527 Aug 24 08:33:50.405146 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1366/2801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:50 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:50.799738 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e5ff42-af84-4802-ac59-d1d74ac113ab", "name": "network-vif-plugged", "status": "completed", "tag": "23d11295-3e21-449f-bd20-e5a063016fcb"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:33:50.809742 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:50.810199 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:50.810615 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:50.824064 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] Creating event network-vif-plugged:23d11295-3e21-449f-bd20-e5a063016fcb for instance e5e5ff42-af84-4802-ac59-d1d74ac113ab on hv-cinder-85427 Aug 24 08:33:50.830191 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-a60807de-9340-409c-90a3-bb3b6522905c req-e64c1ebb-a880-4cfa-9e8b-1b28a92a042a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093643 Aug 24 08:33:50.830797 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1436/2802] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:33:51.425803 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:51.426336 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:51.432705 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:51.433178 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:51.433607 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:51.434288 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:51.434730 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:51.435145 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:51.567526 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:51.575774 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-840266c1-a69e-4e68-adec-33ea6e5c5fc3 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1314 microversion: 2.1 time: 0.153900 Aug 24 08:33:51.576347 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1367/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:51 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:52.597681 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:52.598380 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:52.600987 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=2 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:33:52.601421 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG dbcounter [-] [132893] Writing DB stats nova_cell0:SELECT=6 {{(pid=132893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:33:52.606863 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:52.607337 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:52.607849 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:52.608534 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:52.609007 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:52.609429 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:52.742024 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:52.749542 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-614fc945-bf81-482a-9bf8-54a01daaf7fd tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1463 microversion: 2.1 time: 0.156350 Aug 24 08:33:52.750095 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1437/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:52 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:52.797067 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:52.797555 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:52.799529 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:33:52.805629 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:52.806106 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:52.806562 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:52.807221 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:52.807716 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:52.808132 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:52.835625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:33:53.045714 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:33:53.045938 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:33:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab (ip 10.222.0.26) !!! Aug 24 08:33:53.083911 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c454ee9e-972b-4ab2-abea-53a33747ab75 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 204 len: 0 microversion: 2.1 time: 0.290578 Aug 24 08:33:53.085158 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1368/2805] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 24 08:33:52 2022] DELETE /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:33:53.093148 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:53.094468 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:53.099565 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:53.100584 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:53.101048 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:53.101701 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:53.102140 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:53.102549 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:53.235502 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.policy [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:53.243227 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-411117d7-d4fe-4ab1-83fd-9902d4f4a157 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1469 microversion: 2.1 time: 0.153793 Aug 24 08:33:53.243780 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1438/2806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:53 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:54.263927 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:54.264615 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:54.271074 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:54.271546 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:54.272250 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:54.272958 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:54.273400 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:54.273813 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:54.404571 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:54.413437 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36c72d0f-b056-4934-aa93-12475ade30bc tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1469 microversion: 2.1 time: 0.153461 Aug 24 08:33:54.414147 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1369/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:54 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:54.899163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e5ff42-af84-4802-ac59-d1d74ac113ab", "name": "network-vif-deleted", "tag": "23d11295-3e21-449f-bd20-e5a063016fcb"}]} {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:33:54.909739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:54.909739 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:54.910221 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:54.922714 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.compute.server_external_events [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] Creating event network-vif-deleted:23d11295-3e21-449f-bd20-e5a063016fcb for instance e5e5ff42-af84-4802-ac59-d1d74ac113ab on hv-cinder-85427 Aug 24 08:33:54.927843 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [req-6d37b539-21d2-437c-a351-4eb50d8dc083 req-a504c581-52f5-4ac6-859b-3dd22c03251e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Aug 24 08:33:54.928326 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1439/2808] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 24 08:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:33:55.434873 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:55.435482 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:55.441877 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:55.442357 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:55.442786 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:55.444301 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:55.444782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:55.445203 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:55.474782 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:55.475290 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:55.475715 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:55.476148 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lazy-loading 'fault' on Instance uuid e5e5ff42-af84-4802-ac59-d1d74ac113ab {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:33:55.522625 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188bf9f182844a138d8187428a12d9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee8c1b48a704a41a6768092e0792177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:33:55.530636 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8e8bf0c-2e9f-408b-9359-4b010d17b740 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 200 len: 1304 microversion: 2.1 time: 0.099559 Aug 24 08:33:55.531204 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1370/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:55 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:33:56.554083 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Calling method '>' {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:33:56.561163 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.compute.api [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] [instance: e5e5ff42-af84-4802-ac59-d1d74ac113ab] Fetching instance by UUID {{(pid=132893) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:33:56.561878 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:56.562366 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:56.562791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:56.563461 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Acquiring lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:33:56.563903 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:33:56.564316 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG oslo_concurrency.lockutils [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Lock "5e7d4f2d-bfdc-48c2-8c84-68bb038df6f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:33:56.578296 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.wsgi [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] HTTP exception thrown: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Request method failure captured: Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: request: GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab HTTP/1.1 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept: application/json Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Accept-Encoding: identity Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Connection: close Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Length: 0 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Content-Type: application/json Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Host: 10.222.0.26 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Openstack-System-Scope: None Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: User-Agent: python-urllib3/1.26.11 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Auth-Token: gAAAAABjBeJifHvigeWI8HpajbpRJMLAu7hyko7O2zw-judavOgIsrgehA9dwd2hLUCZuXZhdDxNkTNRAfeA3wwknwLXhTtTrlLSs_F9r_aOAHF1iUZgxv1pty9uctaSWY9dWPUDGU_yvtqwTxvJlZ9bT-dJOsb4Xa8dAXLOdK_ZU98LgcJT2YU Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Id: None Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Domain-Name: None Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Identity-Status: Confirmed Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Is-Admin-Project: True Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Id: default Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Domain-Name: Default Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Id: bee8c1b48a704a41a6768092e0792177 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Project-Name: tempest-VolumesNegativeTest-709905956 Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Role: member,reader Aug 24 08:33:56.580022 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Roles: member,reader Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bee8c1b48a704a41a6768092e0792177"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bee8c1b48a704a41a6768092e0792177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee8c1b48a704a41a6768092e0792177"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee8c1b48a704a41a6768092e0792177"}]}] Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant: tempest-VolumesNegativeTest-709905956 Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Id: bee8c1b48a704a41a6768092e0792177 Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-Tenant-Name: tempest-VolumesNegativeTest-709905956 Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User: tempest-VolumesNegativeTest-709905956-project Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Id: default Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Domain-Name: Default Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Id: 188bf9f182844a138d8187428a12d9c4 Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: X-User-Name: tempest-VolumesNegativeTest-709905956-project Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: method: > Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: exception: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. Aug 24 08:33:56.581526 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: action_args: {'id': 'e5e5ff42-af84-4802-ac59-d1d74ac113ab'} Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: {{(pid=132893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:33:56.582374 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. Aug 24 08:33:56.583838 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: ERROR nova.api.openstack.wsgi Aug 24 08:33:56.585690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: DEBUG nova.api.openstack.wsgi [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] Returning 404 to user: Instance e5e5ff42-af84-4802-ac59-d1d74ac113ab could not be found. {{(pid=132893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:33:56.585690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO nova.api.openstack.requestlog [None req-f78216d2-829f-476d-9d09-c40c59687b74 tempest-VolumesNegativeTest-709905956 tempest-VolumesNegativeTest-709905956-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab" status: 404 len: 111 microversion: 2.1 time: 0.032801 Aug 24 08:33:56.585690 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: [pid: 132893|app: 0|req: 1440/2810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 24 08:33:56 2022] GET /compute/v2.1/servers/e5e5ff42-af84-4802-ac59-d1d74ac113ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:35:14.962146 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:35:14.964880 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:35:28.477432 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:35:28.478167 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:37:13.053967 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:37:13.054681 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:38:34.970219 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:38:34.970791 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:38:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:38:43.219443 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:38:43.220582 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:38:48.485875 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:38:48.486460 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:39:00.903722 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:39:00.904415 dv-cinder-854274-1-iscsi devstack@n-api.service[132892]: Wed Aug 24 08:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:39:03.257702 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:39:03.258170 dv-cinder-854274-1-iscsi devstack@n-api.service[132893]: Wed Aug 24 08:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!